Data Engineering Lead

9 hours ago

Delhi NCR Delhi, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000
Azure Databricks Engineer

We are seeking a skilled data professional to lead our data engineering efforts and establish an efficient data ecosystem. This role requires expertise in designing, implementing, and maintaining scalable data pipelines using Azure Data Bricks, Python, and Spark.

  • Design and implement data pipelines that integrate with various data sources, including databases, APIs, and third-party services.
  • Collaborate with data scientists and analysts to define and refine data requirements, ensuring alignment with business objectives.
  • Develop ETL processes to efficiently extract, transform, and load data into our data lake, utilizing SQL, Python, and Spark.
  • Optimize Spark jobs for performance and efficiency, minimizing processing times and costs.
  • Monitor and troubleshoot production workflows and jobs, resolving issues promptly to ensure high-quality data delivery.
  • Create and maintain technical documentation related to data architecture, ensuring clarity and accessibility for team members.
  • Conduct code reviews to ensure adherence to best practices, promoting a culture of excellence and collaboration.
  • Integrate data from various sources, leveraging your expertise in cloud platforms, such as Azure, AWS, or Google Cloud.
  • Utilize data visualization tools, like Power BI or Tableau, to facilitate data-driven insights and inform business decisions.
  • Collaborate with DevOps teams to deploy and maintain data solutions, ensuring seamless integration and minimal downtime.
  • Stay up-to-date with the latest trends and updates in Azure Data Bricks and related technologies, applying this knowledge to drive innovation and improvement.
  • Provide training and support to team members on data tools and practices, fostering a culture of continuous learning and growth.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Strong expertise in Azure Data Bricks, data lake concepts, and cloud platforms.
  • Proficiency in SQL, Python, and Spark, with experience in developing ETL processes and optimizing Spark jobs.
  • Solid understanding of data warehousing concepts, including data modeling, ETL, and data governance.
  • Excellent problem-solving and analytical skills, with ability to work collaboratively in a diverse team environment.

About Us:

We offer a dynamic and supportive work environment, with opportunities for growth and development. If you are passionate about data engineering and eager to contribute to a cutting-edge team, please submit your application.

  • Senior Data Engineer

    2 days ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 5-10 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading products, we help enterprises...

  • Senior Data Engineer

    3 days ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Data Engineering Lead

    2 days ago

    Delhi, Delhi, India beBeedata Full time US$ 1,50,000 - US$ 2,00,000

    Senior Data EngineerWe are seeking a seasoned professional to lead our data engineering efforts. This role demands expertise in cloud data platforms, Extract-Transform-Load (ETL), and large-scale data warehouses.

  • Data Engineering Lead

    2 days ago

    Delhi, Delhi, India beBeeData Full time ₹ 25,87,200 - ₹ 30,96,000

    Job Title: Senior Data EngineerWe are seeking a seasoned data engineering professional with strong experience in data platforms, ETL tools, and cloud technologies.About the Role:The ideal candidate will lead the design and implementation of enterprise-scale data solutions, provide strategic guidance on data architecture, and play a key role in data...

  • Data Engineering Lead

    2 days ago

    Delhi, Delhi, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Azure Data EngineerWe are seeking a skilled and experienced data engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure. The ideal candidate will have a strong foundation in data integration, transformation, and migration, as well as a passion for working on complex data migration...

  • Engineering Lead

    2 days ago

    Delhi, NCR, India Uplers Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Engineering LeadExperience: 5-8 Years ExpSalary : CompetitivePreferred Notice Period: less than or equal to 60 daysShift: 10:00 AM to 6:00 PM ISTOpportunity Type: Hybrid (Delhi)Placement Type: Permanent(*Note: This is a requirement for one of Uplers' Clients)Must have skills required :MERN, Python, AWSRole Overview DescriptionEngineering LeadLocation: Delhi...

  • Lead Data Engineer

    2 days ago

    Bengaluru, Delhi, NCR, Pune, India Infogain Full time US$ 1,20,000 - US$ 2,00,000 per year

    Job Summary:Big Data Engineer (Lead): As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their requirements and develop architectures that meet their needs. You will also be responsible for providing technical leadership and guidance to your...

  • Lead Data Engineer

    4 weeks ago

    Delhi, Delhi, India TalentBasket Full time

    Job Purpose :We are looking for an experienced Lead Data Engineer with strong expertise in Google BigQuery and working knowledge of Looker to support a data modernization engagement. The candidate will lead efforts in revamping data architecture, optimizing data pipelines, and supporting reporting needs, while mentoring an internal client developer to enable...

  • Leading Data Engineer

    2 days ago

    Delhi, Delhi, India beBeeSoftware Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Software EngineerWe are seeking a seasoned software engineer to join our data engineering team. The ideal candidate will bring deep expertise in Ab Initio, ETL frameworks, and Unix/Linux scripting, with the ability to deliver scalable, reliable, and high-performance data integration solutions.Key Responsibilities:Design, build, and optimize...

  • Lead Azure Data Engineer

    4 weeks ago

    Delhi, Delhi, India Celebal Technologies Full time

    Job Title: Lead Azure Data Engineer Experience Level: Mid - Senior Level Location: Delhi Duration: Fulltime Experience Required: 6-8+ Years Job Summary: We are looking for a Tech Lead – Data Engineering with 6+ years of hands-on experience in designing and building robust data pipelines and architectures on the Azure cloud platform. The ideal...