Skip to content

Spark integrations for working with Lance datasets

License

Notifications You must be signed in to change notification settings

fangbo/lance-spark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

136 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Apache Spark Connector for Lance

The Apache Spark Connector for Lance allows Apache Spark to efficiently read datasets stored in Lance format. By using the Apache Spark Connector for Lance, you can leverage Apache Spark's powerful data processing, SQL querying, and machine learning training capabilities on the AI data lake powered by Lance.

For more details, please visit the documentation website.

For development setup and contribution guidelines, please see CONTRIBUTING.md.

About

Spark integrations for working with Lance datasets

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Java 75.5%
  • Scala 13.2%
  • Python 8.8%
  • Jupyter Notebook 1.0%
  • Makefile 0.8%
  • Dockerfile 0.4%
  • Other 0.3%