Lead Data Engineer

19 hours ago

Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Lead Data Engineer - Databricks Specialist

Job Summary:

We are seeking a seasoned data engineering expert with expertise in Databricks, PySpark, and SQL to spearhead our data engineering initiatives.


Main Responsibilities:
  • Design and develop end-to-end data pipelines using Azure Data Factory for seamless data ingestion and transformation.
  • Collaborate closely with Azure stack modules like Data Lakes and SQL DW to craft robust data solutions.
  • Write efficient SQL, Python, and PySpark code for data processing and transformation.
  • Translate complex business requirements into technical designs.
  • Develop comprehensive mapping documents and transformation rules as per project scope.
  • Communicate project status effectively to stakeholders, ensuring smooth project execution.
Requirements:
  • Minimum 7 years of experience in data ingestion, processing, and analytical pipelines for big data and relational databases.
  • Hands-on experience with Azure services: ADLS, Azure Databricks, Data Factory, Synapse, Azure SQL DB.
  • Proficiency in SQL, Python, and PySpark for data transformation and processing.
  • Familiarity with DevOps and CI/CD deployments.
  • Excellent communication skills and attention to detail in high-pressure situations.
  • Prior experience in the insurance or financial industry is highly desirable.
What We Offer:

A dynamic work environment that fosters growth, collaboration, and innovation.

About Us:

A forward-thinking organization dedicated to delivering cutting-edge data solutions.

  • Digital Engineering Lead Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 253253 NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN -Sr Syniti ADM...

  • Azure Data Engineer

    4 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Aws Lead Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 304644 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AWS Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN Basic Qualifications 3 years ...

  • Azure Data Engineer ll

    4 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Lead Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Saras Analytics Full time

    Job DescriptionAbout Saras Analytics:We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformation, visualization & analysis of data delivered via industry leading products, solutions & services. Our flagship product is...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Incedo Inc. Full time

    Technical Lead Data EngineerExperience :- 7+ to 10 YearsLocation :- Hyderabad / ChennaiNotice :- Looking for Immediate to serving notice periods upto 15th Sept / 30 Days Official Notice Period.Technical Lead – Data Ingestion / ETLSolution Design & Architecture: Lead the design and implementation of scalable data ingestion and ETL pipelines using tools such...

  • Lead Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Genzeon Full time

    Job DescriptionLead Data Engineer - SnowflakeExperience Level: 8+ years (with 3+ in Snowflake)Role Overview:We are looking for an experienced Snowflake Team Lead to oversee both development and production support operations within our managed services model. This is a dual-role leadership position requiring strong technical capabilities in Snowflake as well...

  • Lead AWS Data Engineer

    3 days ago

    Hyderabad, Telangana, India Coforge Full time

    Job Title: Lead AWS Data EngineerSkills: Big Data technologies (e.g., Hadoop, Spark) and AWS S3. Python or Java or Scala. data modeling, ETL processes, and data warehousing solutionsExperience Required: YearsJob Location: Hyderabad, Pune & Greater NoidaWe at Coforge are hiring Lead AWS Data Engineer with following skillset:As a Technical Lead in Data...

  • Lead AWS Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Coforge Full time

    Job Title: Lead AWS Data EngineerSkills: Big Data technologies (e.g., Hadoop, Spark) and AWS S3. Python or Java or Scala. data modeling, ETL processes, and data warehousing solutionsExperience Required: 8 - 12 YearsJob Location: Hyderabad, Pune & Greater NoidaWe at Coforge are hiring Lead AWS Data Engineer with following skillset:- As a Technical Lead in...

  • Lead AWS Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Coforge Full time

    Job Title: Lead AWS Data Engineer Skills: Big Data technologies (e.g., Hadoop, Spark) and AWS S3. Python or Java or Scala. data modeling, ETL processes, and data warehousing solutions Experience Required: 8 - 12 Years Job Location: Hyderabad, Pune & Greater Noida We at Coforge are hiring Lead AWS Data Engineer with following skillset: As a Technical...