Databricks engineer

5 days ago

Belgaum, Karnataka, India DataE2E Technologies Full time

Job Title: Databricks Engineer (Remote)Location: 100 % RemoteJob Type: Full-TimeShift timings: 3 pm - 11 pm ISTAbout the Role:We are looking for an experienced Databricks Engineer with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. You'll work with cross-functional teams to create robust data pipelines and ensure the reliability, quality, and observability of data across platforms.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Optimize data workflows for performance, cost-efficiency, and reliability.Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Implement best practices in data governance, security, and quality management.Mentor junior engineers and provide technical leadership in data engineering best practices.Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity.Required Skills & Experience6-7 years of experience in Data Engineering.Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).Strong experience with Py Spark, Spark SQL, and Scala.Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).Proficiency in data modeling, ETL development, and data warehousing concepts.Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).Strong SQL development skills with a focus on performance tuning.Experience in implementing CI/CD pipelines for data solutions.

  • Data Engineering Solutions Specialist

    7 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineering Solutions SpecialistJob Summary:We are seeking an experienced Data Engineering Solutions Specialist to design, develop and maintain large-scale data engineering solutions using Azure Databricks.Main Responsibilities:Develop and implement ETL (Extract, Transform, Load) processes to integrate data from various sources.Design and implement data...

  • Senior Data Engineer

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a senior Databricks data engineer to design and develop high-performance data pipelines.Job Overview:The ideal candidate will have expertise in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Develop scalable data pipelines using Databricks and PySparkImplement and manage data solutions on AWS, including...

  • Principal Data Engineering Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Key Responsibilities:Develop large-scale data engineering solutions utilizing Python and SQL to drive business growth.Gain expertise in distributed data processing and storage technologies, including Apache Spark and Hadoop, to efficiently manage massive datasets.Model data and create production-ready ETL pipelines to handle TBs of data, ensuring seamless...

  • Cloud Data Engineer Specialist

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are currently seeking a skilled data engineer to contribute to our dynamic team.Key Responsibilities:Data Pipeline Development: Design and develop scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate data from various sources, ensuring data quality and consistency.Performance Optimization: Optimize...

  • Data Engineer

    2 weeks ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data SpecialistWe are seeking a highly skilled professional with 4+ years of experience in data engineering to lead the design, development, and maintenance of scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark. This role requires strong programming skills in Python and Scala, as well as hands-on...

  • Cloud Data Engineering Specialist

    6 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewThis is a contract remote position for an experienced data engineer with 3–4 years of experience in designing, developing and maintaining large-scale data processing solutions using PySpark and Python.We seek a highly motivated individual who can bring hands-on expertise in Spark, SQL, and real-time data streaming to contribute to the design...

  • Data Engineering Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineering Specialist to develop, optimize and maintain automated data pipelines supporting business intelligence initiatives. This role will focus on building production-ready workflows for data ingestion, transformation, quality checks and metadata integration,...

  • Data Engineering Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time US$ 1,20,000 - US$ 1,80,000

    Job OpportunityWe are seeking a skilled data engineer to join our team. This role involves designing, developing and maintaining ETL/ELT pipelines using PySpark, AWS and Databricks.The ideal candidate will have 5+ years of experience in data engineering with a strong background in Python and SQL. They will be proficient in Linux/Bash scripting for automation...

  • Senior Big Data Solutions Architect

    5 days ago

    Belgaum, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Databricks Engineer OpportunityWe are seeking a skilled Databricks engineer to join our team. The ideal candidate will have hands-on experience in Databricks production environments and a deep understanding of modern data architecture.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on DatabricksLead the architecture and...

  • Senior Data Engineer Architect

    2 weeks ago

    Belgaum, Karnataka, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    Job Title: Senior Software Architect - Data EngineeringJob SummaryWe are seeking an experienced Senior Software Architect to lead our data engineering efforts. This individual will be responsible for designing and building a scalable data pipeline using Apache Beam and Databricks.About the RoleThis is a critical position that requires a deep understanding of...