Skip to content

Instantly share code, notes, and snippets.

@tingletech

tingletech/Z.txt

Last active October 18, 2019 20:27
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save tingletech/c59a9e50e99a885396b7ecbc9daadb88 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save tingletech/c59a9e50e99a885396b7ecbc9daadb88 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
_uniq_ratio.sql
SELECT
first(collection_name)[0] AS collection_name,
count(title[0]) AS total,
count(distinct(title[0])) AS uniq,
count(distinct(title[0]))/count(title[0]) AS uniq_ratio
FROM calisphere
GROUP BY collection_url[0]
ORDER BY uniq_ratio
Raw
log.spark
scala> var r = spark.sql("select first(collection_name)[0] as collection_name, count(title[0]) as total, count(distinct(title[0])) as uniq, count(distinct(title[0]))/count(title[0]) as uniq_ratio from calisphere group by collection_url[0] order by uniq_ratio")
r: org.apache.spark.sql.DataFrame = [collection_name: string, total: bigint ... 2 more fields]
scala> r.count
res48: Long = 1769
scala> r.show(100, false)
+----------------------------------------------------------------------------------------------------------+-----+-----+---------------------+
|collection_name |total|uniq |uniq_ratio |
+----------------------------------------------------------------------------------------------------------+-----+-----+---------------------+
|Julian P. Graham Collection of Photographic Negatives |1338 |2 |0.0014947683109118087|
|Spanish Civil War Children's Drawings |632 |1 |0.0015822784810126582|
|UCSD Guardian |3060 |9 |0.0029411764705882353|
|College/University Times Newspaper Collection |964 |3 |0.0031120331950207467|
|Helstien (Melvyn) Papers |473 |2 |0.004228329809725159 |
|Bear Facts |368 |2 |0.005434782608695652 |
|Kuna Collection |164 |1 |0.006097560975609756 |
|Fashion Plate Collection |6203 |81 |0.013058197646300177 |
|Amerine (Maynard) Wine Label Collection |4970 |70 |0.014084507042253521 |
|Ueda, Marie Collection |200 |3 |0.015 |
|The Pacifican |53 |1 |0.018867924528301886 |
|Gerber Oceano Collection |52 |1 |0.019230769230769232 |
|Janet Gray Hayes Collection |50 |1 |0.02 |
|Construction Photographs of the San Francisco-Oakland Bay Bridge, 1931-1936 |1161 |25 |0.02153316106804479 |
|Rubin (Arnold) Papers |1348 |34 |0.025222551928783383 |
|UCSD Student Newspapers |653 |20 |0.030627871362940276 |
|Muramoto (Walter) Collection |361 |17 |0.04709141274238227 |
|Pacific Review |21 |1 |0.047619047619047616 |
|Gilbert and Sullivan Advertising Cards |230 |12 |0.05217391304347826 |
|Vermilion Family Correspondence |34 |2 |0.058823529411764705 |
|Lange (Dorothea) Collection |20820|1282 |0.061575408261287226 |
|Susanne B. Wilson Collection |64 |4 |0.0625 |
|The Records of an Unbroken Friendship but the Mortal Severance, 1907-1924 |80 |5 |0.0625 |
|Jerome Motto Papers |15 |1 |0.06666666666666667 |
|Palm Springs Telephone Directory Issues |14 |1 |0.07142857142857142 |
|Spanish Civil War Postage Stamps |362 |30 |0.08287292817679558 |
|Construction Photographs of the Golden Gate Bridge |372 |31 |0.08333333333333333 |
|Robert Glasheen Photographs |8309 |744 |0.08954146106631364 |
|World War One American Poster Collection |11 |1 |0.09090909090909091 |
|Ruth-Marion Baruch and Pirkle Jones Photographs |6647 |658 |0.09899202647811042 |
|Chadwick & Sykes photograph albums of contract engineering projects |67 |7 |0.1044776119402985 |
|UCSD Health Science Communications Photographs |1256 |138 |0.10987261146496816 |
|Pepperdine University Commencement Collection |6050 |705 |0.11652892561983472 |
|University Communications & Public Relations Materials: Photographs |1729 |206 |0.11914401388085599 |
|Dr. Seuss Advertising Artwork |198 |24 |0.12121212121212122 |
|California Revealed from Berkeley Public Library |8 |1 |0.125 |
|The Racquet Club Issues |6 |1 |0.16666666666666666 |
|Chico Army Air Field Collection |94 |16 |0.1702127659574468 |
|Thurgood Marshall College Photographs |767 |132 |0.17209908735332463 |
|Herman Baca Collection |4343 |790 |0.18190191112134468 |
|Desert Circus Issues |5 |1 |0.2 |
|Harry Crosby Photographs |5312 |1113 |0.20952560240963855 |
|Spanish-American War volunteer infantry, San Francisco |182 |40 |0.21978021978021978 |
|Chinese News Service posters from the Second World War era |9 |2 |0.2222222222222222 |
|Bridgman (Lilian) Photograph Collection, ca. 1881-1940 |123 |28 |0.22764227642276422 |
|Antiquities of the Institute for Antiquity and Christianity |133 |31 |0.23308270676691728 |
|Micky Moore Collection |2553 |619 |0.24245985115550334 |
|Panoramic Fire Lookout Photographs, 1934-1935, 1937 |98 |24 |0.24489795918367346 |
|Daily Pilot |4 |1 |0.25 |
|Gerhardt (Wally) Photograph Collection |1424 |363 |0.25491573033707865 |
|Alband (Linda) Collection of Randy Shilts Materials |231 |60 |0.2597402597402597 |
|Palos Verdes Homes Association Photo Collection |1775 |462 |0.26028169014084507 |
|Bonney (Thérèse) Photograph Collection |2177 |586 |0.2691777675700505 |
|Villa (Esteban) papers |582 |157 |0.2697594501718213 |
|Cinewest Archive |578 |163 |0.2820069204152249 |
|Marin City |78 |22 |0.28205128205128205 |
|Edson Smith Photo Collection |2831 |813 |0.28717767573295655 |
|Superintendent Reports |100 |29 |0.29 |
|Sara Holmes Boutelle Papers |2034 |590 |0.29006882989183874 |
|University of California, Irvine Communications Photographs, Slides Series |34032|10420|0.30618241654913025 |
|Paget-Fredericks (Joseph Rous) Dance Collection |368 |114 |0.30978260869565216 |
|University Archives Photograph Collection |14705|4712 |0.32043522611356684 |
|History of the UC San Diego Visual Arts Department |404 |130 |0.3217821782178218 |
|Fiske (George), Views of Yosemite, ca. 1880-1890 |68 |22 |0.3235294117647059 |
|Larry Oglesby Collection |7874 |2569 |0.32626365252730505 |
|Sacramento Room Periodicals |183 |60 |0.32786885245901637 |
|County of Los Angeles Department of Parks and Recreation Photo Collection |1539 |507 |0.32943469785575047 |
|1984 Free Speech Movement Memorial Rally - Photographs |3 |1 |0.3333333333333333 |
|Phelan (James D.) Papers |9 |3 |0.3333333333333333 |
|California Revealed from Santa Barbara Public Library |186 |62 |0.3333333333333333 |
|Alaska Commercial Company Records |18 |6 |0.3333333333333333 |
|Raymond Cree Junior High School Yearbook Issues |3 |1 |0.3333333333333333 |
|Roger Reynolds Ping Collection |413 |139 |0.3365617433414044 |
|Kaiser (Henry J.) Collection - Selections From the Pictorial Collection, 1941-1946 |903 |308 |0.34108527131782945 |
|Edward G. Trinkkeller Papers |32 |11 |0.34375 |
|Merriam (C. Hart) Collection of Native American Photographs |1441 |497 |0.34489937543372656 |
|Jay Kay Klein photographs and papers on science fiction fandom |5933 |2103 |0.35445811562447327 |
|Palm Springs High School Yearbook Issues |25 |9 |0.36 |
|Sonoma County Aerial Photography Collection |1667 |601 |0.36052789442111577 |
|Horner Architectural Photography Collection |81 |31 |0.38271604938271603 |
|Sherman Indian Museum collection |13728|5258 |0.38301282051282054 |
|DWP Photo Collection |4297 |1672 |0.38910868047474984 |
|Derleth (Charles) Papers - Photographs of the San Francisco Earthquake and Fire, 1868-1908, bulk 1906-1908|554 |216 |0.3898916967509025 |
|Muybridge (Eadweard) Stereographic Views of San Francisco Bay Area Locations, ca. 1865-ca. 1879 |40 |16 |0.4 |
|Collection of City of Rancho Cucamonga Local History Photographs |170 |69 |0.40588235294117647 |
|Smith Family Papers on World War II |29 |12 |0.41379310344827586 |
|Pacific Coast Committee on American Principles and Fair Play Records |325 |136 |0.41846153846153844 |
|Del Carlo (Arnold) Photograph Collection |1798 |760 |0.42269187986651835 |
|Eastman's Originals Collection |13192|5682 |0.43071558520315345 |
|Center for Sacramento History Photo Collection |79489|34305|0.4315691479324183 |
|William F. Cody Papers |150 |65 |0.43333333333333335 |
|William A. Joseph Collection |1166 |506 |0.4339622641509434 |
|Coalinga, California Photograph Album, ca. 1910-1925 |55 |24 |0.43636363636363634 |
|Iwata (Jack Masaki) Collection |166 |75 |0.45180722891566266 |
|Claremont Colleges Photo Archive |9288 |4203 |0.45251937984496127 |
|Schools - San Domenico |11 |5 |0.45454545454545453 |
|Wood (James Earl) Photograph Collection Relating to Filipinos in California, ca. 1929-1934 |65 |30 |0.46153846153846156 |
|Sonoma County Architectural Drawing Collection |200 |93 |0.465 |
|Lee (K.W.) Papers |238 |111 |0.46638655462184875 |
|University Archives Photographs |3373 |1597 |0.47346575748591757 |
+----------------------------------------------------------------------------------------------------------+-----+-----+---------------------+
only showing top 100 rows
scala>
Raw
log2.spark
scala> var r = spark.sql("select substring(first(collection_name)[0],0,75) as collection_name, count(title[0]) as total, count(distinct(title[0])) as uniq, count(distinct(title[0]))-count(title[0]) as needs, round(count(distinct(title[0]))/count(title[0]),4) as ratio from calisphere group by collection_url[0] order by needs asc")
r: org.apache.spark.sql.DataFrame = [collection_name: string, total: bigint ... 3 more fields]
scala> r.show(100,false)
+---------------------------------------------------------------------------+------+------+------+------+
|collection_name |total |uniq |needs |ratio |
+---------------------------------------------------------------------------+------+------+------+------+
|Center for Sacramento History Photo Collection |79489 |34305 |-45184|0.4316|
|Los Angeles Public Library Photo Collection |129842|100818|-29024|0.7765|
|University of California, Irvine Communications Photographs, Slides Series |34032 |10420 |-23612|0.3062|
|Lange (Dorothea) Collection |20820 |1282 |-19538|0.0616|
|University Archives Photograph Collection |14705 |4712 |-9993 |0.3204|
|Tom & Ethel Bradley Center Photographs |19721 |9934 |-9787 |0.5037|
|Sherman Indian Museum collection |13728 |5258 |-8470 |0.383 |
|Maynard L. Parker negatives, photographs, and other material |21219 |12766 |-8453 |0.6016|
|Keystone-Mast Collection |38702 |31104 |-7598 |0.8037|
|Robert Glasheen Photographs |8309 |744 |-7565 |0.0895|
|Eastman's Originals Collection |13192 |5682 |-7510 |0.4307|
|Northeastern California Historical Photograph Collection |23074 |16159 |-6915 |0.7003|
|Sonoma County Library Photograph Collection |23281 |16690 |-6591 |0.7169|
|Fashion Plate Collection |6203 |81 |-6122 |0.0131|
|Ruth-Marion Baruch and Pirkle Jones Photographs |6647 |658 |-5989 |0.099 |
|Pepperdine University Commencement Collection |6050 |705 |-5345 |0.1165|
|Larry Oglesby Collection |7874 |2569 |-5305 |0.3263|
|Pollay Advertising Collection |11466 |6189 |-5277 |0.5398|
|San Francisco Historical Photograph Collection |19996 |14748 |-5248 |0.7375|
|Claremont Colleges Photo Archive |9288 |4203 |-5085 |0.4525|
|Amerine (Maynard) Wine Label Collection |4970 |70 |-4900 |0.0141|
|Hoover Institution Digital Collections |51844 |47060 |-4784 |0.9077|
|Harry Crosby Photographs |5312 |1113 |-4199 |0.2095|
|CSU Japanese American Digitization Project |23318 |19428 |-3890 |0.8332|
|Jay Kay Klein photographs and papers on science fiction fandom |5933 |2103 |-3830 |0.3545|
|Image Archive |10095 |6438 |-3657 |0.6377|
|Herman Baca Collection |4343 |790 |-3553 |0.1819|
|History San Jose Online Catalog |18913 |15772 |-3141 |0.8339|
|UCSD Guardian |3060 |9 |-3051 |0.0029|
|California History Section Picture Catalog |35156 |32521 |-2635 |0.925 |
|DWP Photo Collection |4297 |1672 |-2625 |0.3891|
|Monrovia Legacy Project |5173 |2586 |-2587 |0.4999|
|Worlds Fair Collection |6887 |4605 |-2282 |0.6687|
|Scripps Institution of Oceanography Photographs |8641 |6441 |-2200 |0.7454|
|Long Beach Fireman's Historical Museum Photographs Collection |4375 |2336 |-2039 |0.5339|
|Edson Smith Photo Collection |2831 |813 |-2018 |0.2872|
|Gallaher Collection |12875 |10870 |-2005 |0.8443|
|Micky Moore Collection |2553 |619 |-1934 |0.2425|
|Cylinder Audio Archive |11293 |9463 |-1830 |0.838 |
|Dorothy M. Hill Collection |5721 |3926 |-1795 |0.6862|
|University Archives Photographs |3373 |1597 |-1776 |0.4735|
|Los Angeles Daily News Negatives |5169 |3400 |-1769 |0.6578|
|Bonney (Thérèse) Photograph Collection |2177 |586 |-1591 |0.2692|
|Photographs |13148 |11559 |-1589 |0.8791|
|University Communications & Public Relations Materials: Photographs |1729 |206 |-1523 |0.1191|
|Art Collection |5912 |4440 |-1472 |0.751 |
|Roger M. Keesing Photographs |2982 |1525 |-1457 |0.5114|
|Avery E. Field photographs |2934 |1478 |-1456 |0.5037|
|Sara Holmes Boutelle Papers |2034 |590 |-1444 |0.2901|
|Julian P. Graham Collection of Photographic Negatives |1338 |2 |-1336 |0.0015|
|Rubin (Arnold) Papers |1348 |34 |-1314 |0.0252|
|Palos Verdes Homes Association Photo Collection |1775 |462 |-1313 |0.2603|
|War Relocation Authority Photographs of Japanese-American Evacuation and Re|6869 |5727 |-1142 |0.8337|
|Santa Monica Image Archives |6023 |4881 |-1142 |0.8104|
|Construction Photographs of the San Francisco-Oakland Bay Bridge, 1931-1936|1161 |25 |-1136 |0.0215|
|UCSD Health Science Communications Photographs |1256 |138 |-1118 |0.1099|
|Sonoma County Aerial Photography Collection |1667 |601 |-1066 |0.3605|
|Gerhardt (Wally) Photograph Collection |1424 |363 |-1061 |0.2549|
|Del Carlo (Arnold) Photograph Collection |1798 |760 |-1038 |0.4227|
|County of Los Angeles Department of Parks and Recreation Photo Collection |1539 |507 |-1032 |0.3294|
|Golden State Mutual Life Insurance Company records |2824 |1818 |-1006 |0.6438|
|College/University Times Newspaper Collection |964 |3 |-961 |0.0031|
|Merriam (C. Hart) Collection of Native American Photographs |1441 |497 |-944 |0.3449|
|Bartlett (Adelbert) Papers |2629 |1730 |-899 |0.658 |
|El Pueblo Monument Photo Collection |4236 |3360 |-876 |0.7932|
|California Ethnographic Field Photographs |3300 |2452 |-848 |0.743 |
|Western Sonoma County Historical Society Collection |6307 |5476 |-831 |0.8682|
|California Historical Topographic Maps |1800 |973 |-827 |0.5406|
|Historic Stockton Photographs |3259 |2433 |-826 |0.7465|
|Japanese American Evacuation and Resettlement Records |4040 |3242 |-798 |0.8025|
|San Fernando Valley History |4080 |3298 |-782 |0.8083|
|Ed Fletcher Papers |4147 |3373 |-774 |0.8134|
|Howard E. Gulick Photographs |2267 |1520 |-747 |0.6705|
|Muybridge (Eadweard), Lone Mountain College Collection of Stereographs |1724 |988 |-736 |0.5731|
|Palisades Historical Image Collection |3110 |2394 |-716 |0.7698|
|Hagemeyer (Johan) Photograph Collection |1500 |784 |-716 |0.5227|
|Frasher Foto Postcard Collection |5018 |4308 |-710 |0.8585|
|William A. Joseph Collection |1166 |506 |-660 |0.434 |
|Thurgood Marshall College Photographs |767 |132 |-635 |0.1721|
|UCSD Student Newspapers |653 |20 |-633 |0.0306|
|Spanish Civil War Children's Drawings |632 |1 |-631 |0.0016|
|Nag Hammadi Archive |1897 |1284 |-613 |0.6769|
|Harold Scheffler Photographs |1370 |774 |-596 |0.565 |
|Kaiser (Henry J.) Collection - Selections From the Pictorial Collection, 19|903 |308 |-595 |0.3411|
|The Korean War Photography of Hanson A. Williams, Jr |2575 |1989 |-586 |0.7724|
|Jonathan Silent Film Collection |1852 |1268 |-584 |0.6847|
|Best of Atlas Negative Images |1117 |534 |-583 |0.4781|
|Richard Cross Photographs (Bradley Center) |1410 |830 |-580 |0.5887|
|Galería De La Raza archives |1239 |691 |-548 |0.5577|
|Los Angeles Times Photographic Archives |8340 |7795 |-545 |0.9347|
|John Nopel Photograph Collection |2091 |1547 |-544 |0.7398|
|Self-Help Graphics and Art archives |1560 |1018 |-542 |0.6526|
|Edward A. Rogers collection of Cardinell-Vincent Company and Panama-Pacific|2186 |1646 |-540 |0.753 |
|Julia Morgan Papers |2544 |2026 |-518 |0.7964|
|Dr. Walter Lindley Scrapbooks |5815 |5308 |-507 |0.9128|
|Centro Cultural de la Raza archives |967 |476 |-491 |0.4922|
|Harry Mayo Surfing Photography Collection |1341 |857 |-484 |0.6391|
|Local News Index |26146 |25664 |-482 |0.9816|
|Helstien (Melvyn) Papers |473 |2 |-471 |0.0042|
|Sacramento Room Photographs |2513 |2043 |-470 |0.813 |
+---------------------------------------------------------------------------+------+------+------+------+
only showing top 100 rows
scala>
Raw
notes.md

run in the spark-shell after

val calisphereDF = spark.read.json("/Users/tingle/data/solr-prod.json.bz2")
calisphereDF.registerTempTable("calisphere")

Spark SQL built in fuctions at apache site

SQL Group By at sqlitetutorial

Raw
Z.txt
scala> var r = spark.sql("select substring(first(repository_name)[0],0,50) as repository_name, first(campus_name)[0] as campus, count(title[0]) as total, count(distinct(title[0])) as uniq, count(distinct(title[0]))/count(title[0]) as uniq_ratio from calisphere group by repository_url[0] order by uniq_ratio desc, uniq desc")
r: org.apache.spark.sql.DataFrame = [repository_name: string, campus: string ... 3 more fields]
scala> r.show(300,false)
+--------------------------------------------------+----------------+------+------+-------------------+
|repository_name |campus |total |uniq |uniq_ratio |
+--------------------------------------------------+----------------+------+------+-------------------+
|Television Academy Foundation |null |904 |904 |1.0 |
|California State University, Stanislaus. Library |null |260 |260 |1.0 |
|Architecture and Design Collection, Art, Design an|UC Santa Barbara|213 |213 |1.0 |
|American Jewish University |null |213 |213 |1.0 |
|Covina Public Library |null |200 |200 |1.0 |
|Dublin Heritage Park and Museums |null |197 |197 |1.0 |
|Sacramento City College |null |167 |167 |1.0 |
|Orange County Archives |null |165 |165 |1.0 |
|San Bruno Public Library |null |159 |159 |1.0 |
|San Francisco State University, J. Paul Leonard Li|null |145 |145 |1.0 |
|Santa Clara City Library |null |142 |142 |1.0 |
|Computer History Museum |null |121 |121 |1.0 |
|El Dorado County Library |null |116 |116 |1.0 |
|Intel Museum |null |105 |105 |1.0 |
|Yolo County Archives |null |105 |105 |1.0 |
|Library, Tobacco Control Archives |UC San Francisco|105 |105 |1.0 |
|Menlo Park Historical Association |null |100 |100 |1.0 |
|Napa County Historical Society |null |99 |99 |1.0 |
|California State University, Fullerton, Center for|null |96 |96 |1.0 |
|Mingei International Museum |null |95 |95 |1.0 |
|San Francisco State University, Labor Archives and|null |94 |94 |1.0 |
|California State Polytechnic University, Pomona, S|null |87 |87 |1.0 |
|Headlands Center for the Arts |null |81 |81 |1.0 |
|De Anza College, California History Center |null |79 |79 |1.0 |
|Research Library, Natural History Museum of Los An|null |78 |78 |1.0 |
|Pacifica Radio Archives |null |62 |62 |1.0 |
|Southern Mono Historical Society |null |61 |61 |1.0 |
|Women's Museum of California |null |50 |50 |1.0 |
|Laguna Art Museum |null |49 |49 |1.0 |
|Dixon Public Library |null |49 |49 |1.0 |
|Los Angeles County Metropolitan Transportation Aut|null |45 |45 |1.0 |
|Harrison Memorial Library |null |44 |44 |1.0 |
|Laguna Beach Historical Society |null |43 |43 |1.0 |
|Institute for Research on Labor and Employment Lib|UCLA |41 |41 |1.0 |
|Benicia Public Library |null |41 |41 |1.0 |
|Library Special Collections, Center for Oral Histo|UCLA |38 |38 |1.0 |
|Manzanar National Historic Site |null |34 |34 |1.0 |
|Bishop Chamber of Commerce and Visitor Center |null |33 |33 |1.0 |
|Alameda Free Library |null |32 |32 |1.0 |
|Moffitt Library, Media Resources Center |UC Berkeley |30 |30 |1.0 |
|de Saisset Museum |null |28 |28 |1.0 |
|California State University, Bakersfield |null |26 |26 |1.0 |
|California State Parks, Monterey District |null |22 |22 |1.0 |
|Chabot Space and Science Center |null |21 |21 |1.0 |
|California Judicial Center Library, Special Collec|null |20 |20 |1.0 |
|Charles E. Young Research Library |UCLA |20 |20 |1.0 |
|California State University, San Marcos |null |17 |17 |1.0 |
|California Automobile Museum |null |16 |16 |1.0 |
|Allan Hancock College |null |16 |16 |1.0 |
|Visual Communications |null |15 |15 |1.0 |
|Palo Alto Woman's Club |null |13 |13 |1.0 |
|Writers Guild Foundation Archive |null |13 |13 |1.0 |
|Oakland Public Library, César E. Chávez Branch |null |12 |12 |1.0 |
|Sierra Club, William E. Colby Memorial Library |null |12 |12 |1.0 |
|Ayn Rand Archives |null |12 |12 |1.0 |
|San Francisco Theological Seminary |null |11 |11 |1.0 |
|San Joaquin County Historical Society and Museum |null |11 |11 |1.0 |
|Other Minds Archive |null |10 |10 |1.0 |
|JKL Museum of Telephony |null |8 |8 |1.0 |
|Little People of America Archive |null |7 |7 |1.0 |
|ArtCenter College of Design |null |7 |7 |1.0 |
|Sonoma State University Art and Art History Depart|null |6 |6 |1.0 |
|History Center of San Luis Obispo County |null |6 |6 |1.0 |
|Libraries, Digital Scholarship Services |UC Irvine |6 |6 |1.0 |
|Corita Art Center |null |5 |5 |1.0 |
|Henry J. Bruman Map Collection |UCLA |4 |4 |1.0 |
|Notre Dame de Namur University |null |4 |4 |1.0 |
|SAG-AFTRA Foundation |null |3 |3 |1.0 |
|Watsonville Public Library |null |3 |3 |1.0 |
|San Luis Obispo County Library |null |3 |3 |1.0 |
|C.V. Starr East Asian Library |UC Berkeley |3 |3 |1.0 |
|East Bay Media Center |null |2 |2 |1.0 |
|John Morearty Archive |null |2 |2 |1.0 |
|Monterey County Historical Society |null |2 |2 |1.0 |
|Sisters of the Presentation, San Francisco |null |2 |2 |1.0 |
|Museum of Western Film History |null |2 |2 |1.0 |
|Kern Antelope Historical Society |null |1 |1 |1.0 |
|Tenderloin Museum |null |1 |1 |1.0 |
|Library Special Collections, Medicine and Science |UCLA |1 |1 |1.0 |
|Library, University Archives |UC San Francisco|997 |996 |0.9989969909729187 |
|Institute for Research on Labor and Employment Col|UC Berkeley |2728 |2724 |0.998533724340176 |
|Claire Trevor School of the Arts Media Center |UC Irvine |573 |571 |0.9965095986038395 |
|Grunwald Center for the Graphic Arts |UCLA |246 |245 |0.9959349593495935 |
|Salinas Public Library |null |734 |731 |0.9959128065395095 |
|San Mateo Public Library |null |232 |231 |0.9956896551724138 |
|StoryCenter |null |219 |218 |0.9954337899543378 |
|Mission Viejo Library |null |412 |410 |0.9951456310679612 |
|Monterey County Free Libraries |null |200 |199 |0.995 |
|Ethnic Studies Library |UC Berkeley |1864 |1854 |0.9946351931330472 |
|Inyo County Free Library |null |161 |160 |0.9937888198757764 |
|California State Archives |null |8129 |8078 |0.9937261655800221 |
|Agua Caliente Cultural Museum |null |5948 |5907 |0.9931069266980498 |
|Zuckerberg San Francisco General Hospital Archives|UC San Francisco|143 |142 |0.993006993006993 |
|Riverside Public Library |null |141 |140 |0.9929078014184397 |
|South San Francisco Public Library |null |138 |137 |0.9927536231884058 |
|Library, Research Data Curation Program |UC San Diego |9688 |9610 |0.9919488026424442 |
|Society of California Pioneers |null |1656 |1640 |0.9903381642512077 |
|Oral History Center of The Bancroft Library |UC Berkeley |309 |306 |0.9902912621359223 |
|Pacific Grove Public Library |null |102 |101 |0.9901960784313726 |
|Mill Valley Public Library |null |502 |497 |0.9900398406374502 |
|California State University, Sacramento Library |null |1610 |1593 |0.9894409937888199 |
|University of Southern California, Special Collect|null |186 |184 |0.989247311827957 |
|La Habra Historical Museum |null |86 |85 |0.9883720930232558 |
|Banning Library District |null |381 |376 |0.9868766404199475 |
|Chula Vista Public Library |null |1192 |1176 |0.9865771812080537 |
|The Magnes Collection of Jewish Art and Life |UC Berkeley |148 |146 |0.9864864864864865 |
|Liberty High School Library |null |71 |70 |0.9859154929577465 |
|Sausalito Historical Society |null |71 |70 |0.9859154929577465 |
|Washington Township Museum of Local History |null |69 |68 |0.9855072463768116 |
|Ethnomusicology Archive |UCLA |545 |537 |0.9853211009174312 |
|National City Public Library |null |817 |805 |0.98531211750306 |
|Fullerton College |null |200 |197 |0.985 |
|Coronado Public Library |null |197 |194 |0.9847715736040609 |
|Graduate Theological Union |null |126 |124 |0.9841269841269841 |
|Glendale Public Library |null |824 |810 |0.9830097087378641 |
|California Academy of Sciences |null |104 |102 |0.9807692307692307 |
|Sutter County Library |null |200 |196 |0.98 |
|Yorba Linda Public Library |null |200 |196 |0.98 |
|California State University, East Bay University A|null |247 |242 |0.979757085020243 |
|San Diego History Center (formerly San Diego Histo|null |3491 |3413 |0.9776568318533372 |
|Santa Clara University |null |6790 |6637 |0.9774668630338733 |
|Kern County Library |null |524 |512 |0.9770992366412213 |
|Richmond Public Library |null |260 |254 |0.9769230769230769 |
|Santa Cruz Public Libraries |null |34136 |33316 |0.9759784391844387 |
|Siskiyou County Museum |null |40 |39 |0.975 |
|Welga Project, Filipino American Archive and Repos|UC Davis |119 |116 |0.9747899159663865 |
|University of San Francisco |null |635 |617 |0.9716535433070866 |
|Institute of Governmental Studies Library |UC Berkeley |131 |127 |0.9694656488549618 |
|Woodbury University Library |null |261 |253 |0.9693486590038314 |
|Humboldt State University Library |null |856 |829 |0.9684579439252337 |
|Beaumont Library District |null |187 |181 |0.9679144385026738 |
|Escondido Public Library, Pioneer Room |null |248 |240 |0.967741935483871 |
|Eastern California Museum |null |124 |120 |0.967741935483871 |
|Santa Fe Springs City Library |null |340 |329 |0.9676470588235294 |
|San Mateo County Library, Brisbane Library |null |173 |167 |0.9653179190751445 |
|Berkeley Public Library |null |287 |277 |0.9651567944250871 |
|Mountain View Public Library |null |1268 |1220 |0.9621451104100947 |
|Library, Special Collections |UC San Francisco|3174 |3052 |0.9615626969124134 |
|Placentia Library District |null |200 |192 |0.96 |
|California State Polytechnic University, Pomona, E|null |145 |139 |0.9586206896551724 |
|Inglewood Public Library |null |183 |175 |0.9562841530054644 |
|Marshall Gold Discovery State Historic Park |null |21 |20 |0.9523809523809523 |
|Oakland Public Library, Oakland History Room and M|null |1016 |967 |0.9517716535433071 |
|California State University, Fullerton, University|null |344 |327 |0.9505813953488372 |
|Physical Planning, Design and Construction Archive|UC Merced |77 |73 |0.948051948051948 |
|South Pasadena Public Library |null |1541 |1459 |0.9467878001297858 |
|San Francisco Maritime National Historical Park |null |184 |174 |0.9456521739130435 |
|City of Commerce Public Library |null |200 |189 |0.945 |
|Yuba County Library |null |196 |185 |0.9438775510204082 |
|Redwood City Public Library |null |105 |99 |0.9428571428571428 |
|San Bernardino Public Library |null |421 |396 |0.9406175771971497 |
|Bioscience & Natural Resources Library |UC Berkeley |12166 |11418 |0.9385171790235082 |
|Department of African American Studies |UC Berkeley |16 |15 |0.9375 |
|Libraries, Southeast Asian Archive |UC Irvine |1081 |1011 |0.9352451433857539 |
|Oroville Chinese Temple and Museum Complex |null |365 |341 |0.9342465753424658 |
|University Archives |UC Berkeley |702 |655 |0.9330484330484331 |
|Tulare County Library, Annie R. Mitchell History R|null |1686 |1573 |0.9329774614472124 |
|Southern California Library for Social Studies and|null |200 |186 |0.93 |
|Citrus College, Hayden Memorial Library |null |251 |233 |0.9282868525896414 |
|William Andrews Clark Memorial Library |UCLA |641 |595 |0.9282371294851794 |
|Pasadena Museum of History |null |1721 |1592 |0.9250435793143521 |
|San Joaquin Valley Library System |null |2323 |2146 |0.9238054240206629 |
|Butte County Library |null |270 |249 |0.9222222222222223 |
|California State University, Channel Islands |null |319 |293 |0.9184952978056427 |
|Whittier Public Library |null |263 |241 |0.9163498098859315 |
|California State Library |null |37421 |34237 |0.9149140856738195 |
|Hoover Institution |null |51911 |47088 |0.9070909826433704 |
|Santa Ana Public Library |null |2068 |1869 |0.9037717601547389 |
|California Historical Society |null |5165 |4624 |0.8952565343659245 |
|Albany Library |null |657 |588 |0.8949771689497716 |
|Los Angeles Philharmonic Archives |null |184 |164 |0.8913043478260869 |
|San Diego State University, Special Collections an|null |239 |213 |0.891213389121339 |
|Library, Water Resources Collections and Archives |UC Riverside |7233 |6432 |0.8892575694732476 |
|Port Chicago Naval Magazine National Memorial |null |334 |297 |0.8892215568862275 |
|Richard C. Rudolph East Asian Library |UCLA |125 |111 |0.888 |
|West Valley College Library |null |98 |87 |0.8877551020408163 |
|Monterey Park Bruggemeyer Library |null |308 |273 |0.8863636363636364 |
|Merced County Historical Society and Courthouse Mu|null |200 |177 |0.885 |
|OC Public Libraries |null |4191 |3704 |0.8837986160820807 |
|UC Cooperative Extension Archive |UC Merced |3981 |3509 |0.8814368249183622 |
|California State University, Fresno |null |22642 |19900 |0.8788976238848158 |
|California State Military Museum |null |16 |14 |0.875 |
|Anaheim Public Library |null |1800 |1571 |0.8727777777777778 |
|Arcadia Public Library |null |199 |173 |0.8693467336683417 |
|San Diego Air and Space Museum Library and Archive|null |4395 |3806 |0.8659840728100113 |
|Marin County Free Library |null |1804 |1556 |0.8625277161862528 |
|Fresno County Public Library |null |1678 |1447 |0.8623361144219309 |
|Library and Special Collections |UC Merced |3595 |3093 |0.8603616133518777 |
|Museum of Performance and Design, Performing Arts |null |1674 |1440 |0.8602150537634409 |
|Pomona Public Library |null |5018 |4308 |0.858509366281387 |
|Thousand Oaks Library |null |551 |473 |0.8584392014519057 |
|California College of the Arts Libraries |null |1885 |1615 |0.8567639257294429 |
|California State Railroad Museum Library |null |426 |360 |0.8450704225352113 |
|History San Jose Research Library |null |19355 |16204 |0.8371996900025833 |
|San José State University, Special Collections and|null |7125 |5950 |0.8350877192982457 |
|California State University, Monterey Bay Library |null |162 |135 |0.8333333333333334 |
|Madera County Library, California History and Fami|null |77 |64 |0.8311688311688312 |
|Occidental College Library |null |1065 |885 |0.8309859154929577 |
|Sacramento Public Library |null |4371 |3620 |0.828185769846717 |
|Library Special Collections, University Archives |UCLA |378 |313 |0.828042328042328 |
|Ontario City Library, Robert E. Ellingwood Model C|null |591 |476 |0.805414551607445 |
|California Museum of Photography |UC Riverside |38702 |31104 |0.8036793964136221 |
|Paso Robles Pioneer Museum |null |5 |4 |0.8 |
|Santa Monica Public Library |null |9133 |7267 |0.7956859739406548 |
|Orange Public Library and History Center |null |1414 |1125 |0.7956152758132956 |
|Chapman University, Frank Mt. Pleasant Library of |null |4548 |3602 |0.7919964819700968 |
|University of the Pacific |null |5579 |4413 |0.7910019716795125 |
|Library Special Collections, Charles E. Young Rese|UCLA |23047 |18158 |0.7878682691890485 |
|Upland Public Library |null |400 |315 |0.7875 |
|Bancroft Library |UC Berkeley |79387 |62378 |0.785745777016388 |
|California State University, Dominguez Hills, Arch|null |33190 |26025 |0.7841217234106659 |
|Stanford University, Manuscripts Division |null |148 |116 |0.7837837837837838 |
|San José Public Library. California Room |null |2709 |2112 |0.7796234772978959 |
|Corona Public Library |null |801 |619 |0.7727840199750312 |
|Oakland Public Library, African American Museum an|null |3953 |2976 |0.7528459397925626 |
|Sonoma County Library |null |39424 |29455 |0.7471337256493507 |
|Berkeley Art Museum and Pacific Film Archive |UC Berkeley |6483 |4813 |0.7424032083911769 |
|San Francisco Public Library |null |20135 |14887 |0.7393593245592253 |
|Oxnard Public Library |null |1657 |1216 |0.7338563669281835 |
|Los Angeles Public Library |null |146930|107668|0.7327843190634996 |
|Huntington Library |null |29630 |21655 |0.7308471144110699 |
|Library, Department of Special Research Collection|UC Santa Barbara|19448 |14186 |0.7294323323735088 |
|Libraries, Critical Theory Archive |UC Irvine |1508 |1091 |0.7234748010610079 |
|Library, Digital Library Development Program |UC San Diego |9317 |6721 |0.7213695395513577 |
|Claremont Colleges Library |null |47998 |34280 |0.7141964248510354 |
|Environmental Design Archives |UC Berkeley |1415 |1009 |0.7130742049469965 |
|California Institute of Technology |null |12825 |9126 |0.7115789473684211 |
|Library, Industry Documents Library |UC San Francisco|24341 |17058 |0.7007929008668502 |
|California State University, Chico |null |33811 |22971 |0.6793942799680577 |
|California State University, Northridge |null |36270 |24556 |0.6770333609043286 |
|Phoebe A. Hearst Museum of Anthropology |UC Berkeley |4069 |2744 |0.674367166379946 |
|Burbank Public Library |null |1251 |837 |0.6690647482014388 |
|Sonoma State University Library |null |1324 |869 |0.6563444108761329 |
|Huntington Library, Photo Archives |null |6189 |3971 |0.6416222329940217 |
|Mills College |null |200 |128 |0.64 |
|LA County Library |null |3595 |2275 |0.6328233657858137 |
|Loyola Marymount University, Department of Archive|null |6146 |3823 |0.6220305890009763 |
|California Polytechnic State University, San Luis |null |6957 |4298 |0.6177950265919218 |
|Library, UCSF Medical Center at Mount Zion Archive|UC San Francisco|588 |345 |0.5867346938775511 |
|Library, Special Collections and Archives |UC San Diego |72540 |40531 |0.5587400055141991 |
|Lambda Archives of San Diego |null |403 |225 |0.5583126550868487 |
|Japanese American National Museum |null |1121 |613 |0.5468331846565566 |
|Sourisseau Academy for State and Local History |null |2783 |1495 |0.5371900826446281 |
|Petaluma Historic Library and Museum |null |85 |45 |0.5294117647058824 |
|Santa Clara Valley Water District |null |34 |18 |0.5294117647058824 |
|Center for Asian American Media |null |200 |100 |0.5 |
|Autry Museum of the American West |null |34 |17 |0.5 |
|Humboldt County Historical Society |null |32 |16 |0.5 |
|Shoshone Museum |null |12 |6 |0.5 |
|Ferndale Museum |null |8 |4 |0.5 |
|Monrovia Public Library |null |5173 |2586 |0.4999033442876474 |
|Kitchen Sisters Collection |null |132 |65 |0.49242424242424243|
|Library, Special Collections and University Archiv|UC Riverside |11318 |5439 |0.48056193673793957|
|University Library, University Archives |UC Davis |3373 |1597 |0.47346575748591757|
|Libraries, Special Collections |UC Irvine |3276 |1506 |0.4597069597069597 |
|Center for Sacramento History |null |80050 |34865 |0.4355402873204247 |
|Black Gold Cooperative Library System |null |3588 |1541 |0.42948717948717946|
|Palos Verdes Library District |null |2416 |1022 |0.4230132450331126 |
|University Library, Special Collections |UC Davis |22176 |9185 |0.41418650793650796|
|Pepperdine University, Special Collections and Uni|null |31013 |12756 |0.411311385547996 |
|Rancho Cucamonga Library Services |null |170 |69 |0.40588235294117647|
|GLBT Historical Society |null |648 |253 |0.3904320987654321 |
|Sherman Indian Museum |null |13728 |5258 |0.38301282051282054|
|Libraries, University Archives |UC Irvine |36628 |12830 |0.3502784754832369 |
|Santa Barbara Public Library |null |186 |62 |0.3333333333333333 |
|Palm Springs Public Library |null |56 |16 |0.2857142857142857 |
|Yosemite National Park Archives |null |198 |53 |0.2676767676767677 |
|Special Collections and Archives |UC Santa Cruz |8030 |1555 |0.19364881693648817|
|California State University, Los Angeles |null |1158 |196 |0.1692573402417962 |
|Fowler Museum of Cultural History |UCLA |2130 |163 |0.07652582159624413|
|Oakland Museum of California |null |20856 |1317 |0.06314729574223245|
+--------------------------------------------------+----------------+------+------+-------------------+
scala> r.count
res55: Long = 271
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment