Software Engineer – Build

Mission

The Build team accelerates the velocity of Databricks engineering by innovating in the areas of developer tooling and scaling the build, test, and deployment infrastructure. The Build team also sets and upholds the standard for engineering code quality and empowers Databricks engineering to confidently build mission critical systems that power customer production workloads.

The Build team is searching for a Software Engineer who is driven to empower others and scale their impact with a quickly growing organization. She or he is expected to work in the following areas:

• Work with Bazel and develop tooling to manage and interact with a large mono-repository consisting of multiple languages (Scala, Java, JavaScript, Python, Go) and target platforms (AWS, Azure, Kubernetes, Docker)
• Build and enhance integrations with local development tools (IntelliJ)
• Work with both product focused and open-source teams to improve the integration of Apache Spark within Databricks.
• Develop a Continuous Integration platform to allow the rest of the developers easily test and stress test their services in multiple environments.
• Build a reliable Continuous Delivery platform to accelerate the process of delivering code from developers to customers and build optimizations for our development pipeline
• Integrate and enhance tooling for measuring and understanding code quality and test coverage across all supported languages.
• Backend software development (Scala/Java) and scripting (Python)
• Development and deployment of microservices (Kubernetes/Docker)

Outcomes

• Develop and extend the development cycle for the Databricks product and for Spark.
• Be responsible for full software development lifecycle – design, development, testing, operating in production
• Architect solutions to achieve a high level of reliability, scalability and security
• Communicate effectively with other engineers in the same team, with other teams and with various other stakeholders such as product managers
• Operate in an Agile development environment

Competencies

Minimum:

• Have a BS/MS or PhD degree in Computer Science, Engineering, or a related subject
• A collaborative mindset and good communication skills in English

Preferred:

• Experience with build systems
• Experience with Continuous Integration/Continuous Deployment frameworks
• Good knowledge of Scala or Java
• Good knowledge of Python
• Experience with container technologies, such as Docker
• Good knowledge of Linux OS
• Experience with monitoring frameworks for large systems
• Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)

Benefits

• Medical, dental, vision
• 401k Retirement Plan
• Unlimited Paid Time Off
• Catered lunch (everyday), snacks, and drinks
• Gym reimbursement
• Employee referral bonus program
• Awesome coworkers
• Maternity and paternity plans

About Databricks

Databricks’ mission is to accelerate innovation for its customers by unifying Data Science, Engineering and Business. Databricks’ founders started the Spark research project at UC Berkeley that later became Apache Spark. Databricks provides a Unified Analytics Platform powered by Apache Spark for data science teams to collaborate with data engineering and lines of business to build data products. Users achieve faster time-to-value with Databricks by creating analytic workflows that go from ETL and interactive exploration to production. The company also makes it easier for its users to focus on their data by providing a fully managed, scalable, and secure cloud infrastructure that reduces operational complexity and total cost of ownership. Databricks, venture-backed by Andreessen Horowitz, NEA and Battery Ventures, among others, has a global customer base that includes Viacom, Shell and HP. For more information, visit www.databricks.com ( https://databricks.com/?utm_source=press-release&utm_medium=referral&utm_campaign=emea-opening-pr ).

Apache, Apache Spark and Spark are trademarks of the Apache Software Foundation ( http://www.apache.org/ ).