Prinicipal Data Engineer

Job Description

At Treeverse, our mission is to simplify the lives of data engineers building data intensive applications. We’re looking for an experienced data engineer to help us make using lakeFS even more powerful.

What you'll do

  • Develop high end solutions to the technical challenges we will face when working to fulfil our mission using your deep knowledge of Spark and the Hadoop ecosystem.
  • Maintain the product in production to ensure the best possible service to our customers.
  • Collaborate with the product and lakeFS core development team to develop our offerings.
  • Be part of a fast-moving, fun, and accomplished team.

Requirements

  • 7+ years experience working as a software engineer.
  • At least 3 years experience with Java/Scala and Spark.
  • Must: Deep understanding of Spark’s internals (Query planning, Filesystem API, codegen, etc).
  • Nice to have: experience with PySpark, Hive Metastore, Delta Lake, Apache Hudi or Apache Iceberg.
  • Strong analytical and problem solving skills.
  • Passion for data engineering and for enabling others by making their data easier to access.

Apply for this position