v0.1.17

This Sycamore release contains new writers to the Weaviate and Pinecone vector databases, enhancements to the demo UI, and numerous small features and bug fixes.

What's Changed

• Add Sycamore Partitioner example notebook by @jonfritz in #379
• Various link updates and typo fixes in docs by @hsm207 in #381
• Fix notebook link in docs. by @bsowell in #383
• SummarizeImage example in the SycamorePartitionerExample notebook. by @bsowell in #382
• Jonfritz patch 1 updated description by @jonfritz in #384
• Rename ...Request -> ...Call and ...Response -> ...Reply by @alexaryn in #385
• Responsive Demo UI by @sohamkasar19 in #386
• lineage 1/n: add support for metadata. by @eric-anderson in #387
• Set table object to None when no table is found. by @bsowell in #389
• Fix integration tests. by @eric-anderson in #390
• Add GPT-4o support. by @bsowell in #392
• Updates to Demo UI by @sohamkasar19 in #391
• Updates in demo ui for filtering by @sohamkasar19 in #394
• ensure unique uuids post explode via sequence numbers by @HenryL27 in #398
• Fix model deserialization error by @bohou-aryn in #395
• Convert map.py transforms over to base map. by @eric-anderson in #399
• Convert bbox_merge and mark_misc to new Map style by @eric-anderson in #402
• Add TimeTrace and instrument major pieces of code. by @alexaryn in #388
• Use proxy to provide default settings to the UI by @baitsguy in #404
• Update CONTRIBUTING.md to note that integration tests are currently broken. by @eric-anderson in #403
• FIX: Pdf viewer error by @sohamkasar19 in #406
• Convert Merge from Ray Actor to Ray Task. by @alexaryn in #401
• Tools to look at TimeTrace output. by @alexaryn in #396
• Switch Filter and Enbed over to BaseMapTransform by @eric-anderson in #405
• Convert classes over to new *Map classes 3/n by @eric-anderson in #408
• Explicitly enumerate notebooks to automatically test. by @bsowell in #335
• Add timing for OpenSearch writer. by @alexaryn in #407
• Add weaviate writer by @HenryL27 in #400
• Switch from uuid1() to uuid4() in explode. by @bsowell in #410
• Add remote model server support by @MarkLindblad in #397
• Refactor drawing code to support additional formats. by @bsowell in #409
• Adjust assertion for batch_size resource_arg. by @bsowell in #411
• Convert over to *Map 4/n by @eric-anderson in #412
• Fix OOM on CPU by reducing default batch size by @MarkLindblad in #415
• Update poetry lock files by @eric-anderson in #414
• Fix bug in runtests, it always detected changes. Add --force to force tests by @eric-anderson in #413
• Conversion to base map 5/n: Partition by @eric-anderson in #416
• Remove generate_map_class_from_callable -- *Map 6/n by @eric-anderson in #417
• Fix bug again. Make JSON encoding work. by @alexaryn in #418
• TimeTrace: add RSS and improve usability by @alexaryn in #419
• Fix split_and_convert_to_image when some pages have no elements. by @bsowell in #422
• remove empty lists from documents in weaviate writer by @HenryL27 in #421
• Switch spread props & ndd to BaseMap -- *Map 7/n by @eric-anderson in #425
• Add show_pages pdf utility for visualizing pdf partitioning. by @bsowell in #424
• TimeTrace: Fallback to RUSAGE_SELF when RUSAGE_THREAD isn't present. by @bsowell in #426
• Switch extract_schema to BaseMap -- *Map 8/8 by @eric-anderson in #427
• fixed typo by @tranade in #420
• Remove base64 from model server response by @MarkLindblad in #423
• Pin setuptools so that we can run DETR model on GPU on Linux. by @alexaryn in #431
• Prettier output for timetrace files when using ttviz & ttanal by @alexaryn in #430
• Add Detr json serializability test by @MarkLindblad in #429
• add term_frequency transform by @HenryL27 in #432
• Pinecone connector by @HenryL27 in #435
• Soham demo UI updates by @sohamkasar19 in #428
• Enable table extraction to use GPU. by @alexaryn in #434
• Initial checkin of speed performance benchmarking script. by @alexaryn in #433
• Add pinned dependencies to the sycamore and rps repos. by @bsowell in #436
• Fix cross-test error by @eric-anderson in #439
• Force dependency consistency by @eric-anderson in #440
• Add utility code for working with tables and showing them as HTML. by @bsowell in #438
• Demo UI eslint prettier config by @sohamkasar19 in #437
• bump sycamore version to 0.1.17 by @HenryL27 in #443

New Contributors

• @MarkLindblad made their first contribution in #397
• @tranade made their first contribution in #420

Full Changelog: v0.1.16...v0.1.17