Senior Databricks Engineer

About us:

Where elite tech talent meets world-class opportunities

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today's most complex challenges.

We are building a community of top-tier experts and we're opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.

Structured Onboarding Process

We ensure every member is aligned and empowered:

1. Screening – We review your application and experience in Data & AI, ML engineering, and solution delivery
2. Technical Assessment – 2-step technical assessment process that includes an interactive problem-solving test, and a verbal interview about your skills and experience
3. Matching you to Opportunity – We explore how your skills align with ongoing projects and innovation tracks

Who We're Looking For

We are looking for a skilled and experienced Data Engineer with deep expertise in the Databricks ecosystem to join our data engineering team. You will be responsible for building, optimizing, and maintaining scalable data pipelines on Databricks, leveraging Delta Lake, PySpark, and cloud-native services (AWS, Azure, or GCP). You will collaborate with data scientists, analysts, and business stakeholders to ensure clean, high-quality, and governed data is available for analytics and machine learning use cases.

• 6+ years of experience as a Data Engineer, with at least 4 years hands-on with Databricks in production environments
• Proficient in PySpark and SQL for large-scale data processing
• Deep understanding of Delta Lake features: ACID transactions, schema enforcement, time travel, and vacuuming
• Experience working with cloud platforms: AWS (Glue, S3), Azure (Data Lake, ADF), or GCP (BigQuery, GCS)
• Hands-on experience with Databricks Auto Loader, Structured Streaming, and job scheduling
• Familiarity with Unity Catalog for multi-workspace governance and fine-grained data access
• Experience integrating with orchestration tools (Airflow, ADF) and using infrastructure-as-code for deployment
• Comfortable with version control and automation using Git, Databricks Repos, dbx, or Terraform
• Experience with performance tuning, Z-Ordering, caching strategies, and partitioning best practices

At Xenon7, we're not just building AI systems—we're building a community of talent with the mindset to lead, collaborate, and innovate together.

• Ecosystem of Opportunity: You'll be part of a growing network where client engagements, thought leadership, research collaborations, and mentorship paths are interconnected. Whether you're building solutions or nurturing the next generation of talent, this is a place to scale your influence.
• Collaborative Environment: Our culture thrives on openness, continuous learning, and engineering excellence. You'll work alongside seasoned practitioners who value smart execution and shared growth.
• Flexible & Impact-Driven Work: Whether you're contributing from a client project, innovation sprint, or open-source initiative, we focus on outcomes—not hours. Autonomy, ownership, and curiosity are encouraged here.
• Talent-Led Innovation: We believe communities are strongest when built around real practitioners. Our Innovation Community isn't just a knowledge-sharing forum—it's a launchpad for members to lead new projects, co-develop tools, and shape the direction of AI itself.