Databricks engineer
7 days ago
Role : Databricks Engineer Position : Remote Type : Contract Duration : 3 - 6 months (extendable) Role Overview We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI/CD for data workloads, and optimizing Spark jobs for performance and reliability. Required Skills Strong hands-on experience in building data pipeline using scripting language includes Python, Py Spark and SQL Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF) Hands-on working experience with Azure Dev Ops Repo and CI/CD Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL/ELT processes Understanding of Agile ways of working Any experience working in DBT is a plus Working with Retail Domain is a plus Platform Engineering & Operations Configure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection. Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization. Work with catalogs, Unity Catalog (UC), and access controls for secure data governance. Monitor and troubleshoot performance issues across jobs, clusters, and workflows. CI/CD & Dev Ops Implement CI/CD pipelines for Databricks workflows using Git Hub Actions / Azure Dev Ops / Git Lab. Work with Databricks Repos and Git workflows (branching, PRs, code reviews). Version and promote data pipelines across environments. Cloud & Integration Integrate Databricks with cloud services such as: Azure: ADLS Gen2, Key Vault, ADF, Event Hub, Synapse AWS: S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment) Work with data ingestion frameworks, messaging systems, and event-driven architectures. Quality, Testing & Documentation Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks. Maintain pipeline documentation, data dictionaries, and technical design artifacts. Ensure high data quality, reliability, and observability.
-
Databricks Platform Production Support
1 week ago
Ajmer, India Litmus7 Full timeWe are looking for Enterprise data platform admin to implement and maintain the Databricks platform on AWS/Azure/GCP. Person should have passion to work in agile environment and experience in supporting databricks platform on AWS/Azure/GCP.Responsibilities:Platform Administration: Implement, and maintain the Databricks platform, including workspace setup,...
-
Databricks Platform Production Support
1 week ago
Ajmer, India Litmus7 Full timeWe are looking for Enterprise data platform admin to implement and maintain the Databricks platform on AWS/Azure/GCP. Person should have passion to work in agile environment and experience in supporting databricks platform on AWS/Azure/GCP.Responsibilities:Platform Administration: Implement, and maintain the Databricks platform, including workspace setup,...
-
Azure Data Engineer
3 weeks ago
Ajmer, India LTIMindtree Full timeRole Senior Data Engineer 8 years of experienceKey responsibilities Build reusable utilities templates and automation pipelines Design scalable data engineering frameworks standards and best practices Provide architectural guidance cost optimization and performance tuning support for Data Engineering solutions mainly on Azure Evaluate and onboard new...
-
Senior data engineer
1 week ago
Ajmer, India Tata Consultancy Services Full timeRole**: Senior Data Engineer Required Technical Skill Set: Senior Data Engineer Desired Experience Range: 7 - 12 yrs Notice Period: Immediate to 90 Days only Location of Requirement: Bangalore We are currently planning to do a Virtual Interview Job Description: Primary Skills (Java, Python, etc.) Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks,...
-
Senior Data Engineer
2 weeks ago
Ajmer, India InfoBeans Full timeAbout the Job We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform , Databricks , Snowflake , and Kafka . You will be responsible for...
-
Senior Data Engineer
3 days ago
Ajmer, India Talentoj Full timeExperience: 5–8 Years Location: [Open Location] | Type: Full-TimeJob SummaryWe are looking for a highly experienced Senior Data Engineer with strong expertise in Python, Advanced SQL, Snowflake, Amazon Redshift, Databricks, and Tableau. The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and...
-
Senior Data Engineer
3 days ago
Ajmer, India Talentoj Full timeExperience: 5–8 Years Location: [Open Location] | Type: Full-TimeJob SummaryWe are looking for a highly experienced Senior Data Engineer with strong expertise in Python, Advanced SQL, Snowflake, Amazon Redshift, Databricks, and Tableau. The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and...
-
De architect
3 weeks ago
Ajmer, India Tredence Inc. Full timeRole: Databricks Technical Lead/ DE Architect Experience: 8-13 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging...
-
AIML
3 days ago
Ajmer, India Maneva Consulting Pvt. Ltd. Full timeAI/ML skills with Databricks for our Data Science projects. · Proven hands-on experience in AI/ML concepts with a strong track record of delivering data science projects into production environments. (Must-have).· Proficiency in Python programming, with the ability to write clean, efficient, and maintainable code. (Must have).· Understanding of the...
-
AIML
3 days ago
Ajmer, India Maneva Consulting Pvt. Ltd. Full timeAI/ML skills with Databricks for our Data Science projects. · Proven hands-on experience in AI/ML concepts with a strong track record of delivering data science projects into production environments. (Must-have).· Proficiency in Python programming, with the ability to write clean, efficient, and maintainable code. (Must have).· Understanding of the...