Senior Data Engineer

7 days ago

Navi Mumbai, India Koantek Full time

We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related technologies. Key Responsibilities: Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL and Databricks notebooks. Develop and maintain data models, ETL/ELT processes, ensuring high performance, reliability, scalability, and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrity, and security across all stages of the data lifecycle. Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment. Write clean, modular, and well-documented Python/Scala/SQL/PySpark code. Integrate data from various sources, including APIs, relational and non-relational databases, IoT devices, and external data providers. Ensure adherence to data governance, security, and compliance policies. Required Skills and Experience: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 5-6 years of hands-on experience in data engineering, with a strong focus on Databricks and Apache Spark. Strong programming skills in Python/PySpark and/or Scala, with a deep understanding of Apache Spark. Experience with Azure Databricks. Strong SQL skills for data manipulation, analysis, and performance tuning. Strong understanding of data structures and algorithms, with the ability to apply them to optimize code and implement efficient solutions. Strong understanding of data architecture, data modeling, ETL/ELT processes, and data warehousing concepts. Experience building and maintaining ETL/ELT pipelines in production environments. Familiarity with Delta Lake, Unity Catalog, or similar technologies. Experience working with structured and unstructured data, including JSON, Parquet, Avro, and time-series data. Familiarity with CI/CD pipelines and tools like Azure DevOps, version control (Git), and DevOps practices for data engineering. Excellent problem-solving skills, attention to detail, and ability to work independently or as part of a team. Strong communication skills to interact with technical and non-technical stakeholders. Preferred Qualifications: Experience with Delta Lake and Databricks Workflows. Exposure to real-time data processing and streaming technologies (Kafka, Spark Streaming). Exposure to the data visualization tool Databricks Genie for data analysis and reporting. Knowledge of data governance, security, and compliance best practices.

  • Senior Data Engineer

    3 days ago

    Navi Mumbai, Maharashtra, India A.P. Moller Maersk Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Maersk Line Fleet Management and Technology is responsible for Ship Management of Maersk Line owned container vessels. As a part of the Energy Transition Transparency and Enablement team you will be responsible for developing the strong enterprise architecture, building effective data pipelines based on ADLS/MIDAS and providing end-to-end support on energy...

  • Lead Mechanical Engineer

    3 days ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Senior Lead Sr. Manager

    7 days ago

    Navi Mumbai, India BDx Data Centers Full time

    Lead / Senior Manager Controls SME BDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. What sets BDx apart is our integration of AI-optimized infrastructure, energy-efficient design, and sovereign-grade...

  • Senior data engineer

    3 weeks ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...

  • Senior Data Engineer

    3 weeks ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...

  • Senior Data Engineer

    1 week ago

    Navi Mumbai, India Koantek Full time

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related...

  • Senior Data Engineer

    6 days ago

    navi mumbai, India Koantek Full time

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related...

  • Senior Data Engineer

    6 days ago

    Navi Mumbai, India Koantek Full time

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related...

  • Lead / Senior Manager Controls SME

    2 weeks ago

    Navi Mumbai, India BDx Data Centers Full time

    Lead / Senior Manager Controls SMECompany OverviewBDx is Asia’s fastest-growing data center platform, delivering colocation, build-to-suit, managed services, and interconnection solutions for hyperscalers, large enterprises, and AI customers. Operating across high-growth markets—including Indonesia, Hong Kong, Singapore, and Taiwan—BDx currently boasts...