Data Engineer( ADF, Databricks, Pyspark)

2 weeks ago

Navi Mumbai, Maharashtra, India Flexilant works pvt Ltd Full time ₹ 5,00,000 - ₹ 12,00,000 per year

Company name: PibyThree consulting Services Pvt Ltd.

Location :Navi Mumbai

Start date : ASAP

Job Description :

We are seeking an experienced Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Snowflake, and data warehousing concepts. The Data Engineer will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures.

Key Responsibilities:

  • Design, develop, and deploy data pipelines using Azure Data Factory (ADF)
  • Work with Snowflake to design and implement data warehousing solutions
  • Collaborate with cross-functional teams to identify and prioritize data requirements
  • Develop and maintain data architectures, data models, and data governance policies
  • Ensure data quality, security, and compliance with regulatory requirements
  • Optimize data pipelines for performance, scalability, and reliability
  • Troubleshoot data pipeline issues and implement fixes
  • Stay up-to-date with industry trends and emerging technologies in data engineering

Requirements:

  • 4+ years of experience in data engineering, with a focus on cloud-based data platforms (Azure preferred)
  • 2+ years of hands-on experience with Azure Data Factory (ADF)
  • 1+ year of experience working with Snowflake
  • Strong understanding of data warehousing concepts, data modeling, and data governance
  • Experience with data pipeline orchestration tools such as Apache Airflow or Azure Databricks
  • Proficiency in programming languages such as Python, Java, or C#
  • Experience with cloud-based data storage solutions such as Azure Blob Storage or Amazon S3
  • Strong problem-solving skills and attention to detail

Job Type: Full-time

Pay: ₹500, ₹1,200,000.00 per year

Ability to commute/relocate:

  • Navi Mumbai, Maharashtra: Reliably commute or planning to relocate before starting work (Preferred)

Application Question(s):

  • Current CTC
  • Expected CTC
  • Notice Period

Education:

  • Bachelor's (Preferred)

Experience:

  • total work: 4 years (Preferred)
  • Pyspark: 2 years (Required)
  • Azure Data Factory: 2 years (Required)
  • Databricks: 2 years (Required)

Work Location: In person

  • Azure Data Engineers

    2 weeks ago

    Mumbai, Maharashtra, India Creative Hr Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Sr.Azure Data Engineer (8-12 yrs) Hyd/Blr/Pan India | UK Shift Azure Databricks Engineer (6-12 yrs) Skills:Azure, ADF, Databricks, Python, PySpark, Kafka, SQL, AKS, Delta Lake

  • Databricks Developer

    2 weeks ago

    Mumbai, Maharashtra, India Seaspan Corporation Full time

    Position Description : We are seeking a skilled Databricks Developer to join our Data Development team. Reporting to the Team Lead, Data Development, the Databricks Developer implements robust data pipelines using Apache Spark on Databricks, supports advanced data transformation, and enables scalable data products that serve enterprise analytics and...

  • Databricks Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position Overview:The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.Key...

  • Databricks Developer

    2 weeks ago

    Mumbai, Maharashtra, India Seaspan Corporation Full time US$ 1,20,000 - US$ 2,00,000 per year

    Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry...

  • Senior Databricks Solutions Architect

    2 weeks ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewThis role focuses on leading and implementing data solutions using Databricks on the Azure cloud.The ideal candidate will have experience in designing, building, and optimizing Data Warehouses (DWH) and Data Lakes with scalable ETL applications. They should also be proficient in working with metadata-driven processing, CDC, and advanced...

  • Cloud Data Strategist

    2 weeks ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 75,00,000 - ₹ 1,25,00,000

    Job Title:Cloud Data ArchitectJob Summary:As a Cloud Data Architect, you will design and develop scalable data pipelines using Azure Databricks and ADF. You will administer Databricks environments, including user access, clusters, and Unity Catalog for data lineage, governance, and security.Key Responsibilities:Design, develop, and optimize scalable data...

  • Azure Databricks Lead

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionWe are seeking a skilled professional to lead our Azure Databricks initiative. As a key member of our team, you will be responsible for designing and developing data pipelines using Azure Databricks and PySpark/Scala.You will work closely with our data engineers and architects to ensure efficient data movement and transformation. Additionally,...

  • Scalable Data Solutions Architect

    2 weeks ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Architect About the Role:We are seeking a highly skilled data architect to join our team. The ideal candidate will design and implement robust data pipelines using Apache Spark on Databricks, support advanced data transformation, and enable scalable data products that serve enterprise analytics and reporting needs.This is a hands-on...

  • Data Architectural Specialist

    1 week ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 13,50,000 - ₹ 22,50,000

    Senior Data Engineering ExpertWe are seeking a highly skilled Senior Data Engineering Expert to join our team. As a key member of our data engineering team, you will play a critical role in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Coffeee Full time

    Responsibilities- Responsible for day-to-day tasks related to data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.- Work with Azure Data Factory (ADF) and Databricks to design, develop, and maintain data pipelines and data platforms.- Build operational and automated dashboards, reports with help of Power BI and...