Current jobs related to Leading Data Engineer - Mumbai, Maharashtra - beBeeDataEngineer

  • Lead Mechanical Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Lead Data Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Burns Mcdonnell Full time

    Job DescriptionWe are seeking a seasoned Lead Data Engineer to design, develop, and implement scalable data pipelines. This role is perfect for a professional with 10+ years of experience in data engineering and architecture, with a strong focus on big data technologies. You'll play a critical role in strengthening our data infrastructure, mentoring junior...

  • Lead Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Bradford Consultants Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    The Data Engineering Lead will serve as the solution architect responsible for designing, documenting, implementing and optimizing one or more data platforms including the above-mentioned Data lake. The role will specifically focus on the correct design of the data engineering for setting up a large data warehouse/data lakeRequired Skills & Experience :12+...

  • Lead Data Engineer

    5 days ago

    Mumbai, Maharashtra, India M&G Global Services Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are M&G Global Services Private Limited (formerly known as 10FA India Private Limited, and prior to that Prudential Global Services Private Limited). We are a fully owned subsidiary of the M&G plc group of companies, operating as a Global Capability Centre providing a range of value adding services to the Group since 2003. At M&G our purpose isto give...

  • Data Engineering Lead

    2 weeks ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Key Business Challenges:We require a Data Engineer to develop high-quality data solutions that drive business growth and improvement.Develop Alteryx workflows to support business needsLiaise with stakeholders to ensure requirements are understood and metLead testing and quality assuranceFollow established change control processes to ensure integrity of...

  • Senior Data Engineering Lead

    2 weeks ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job Description: We are seeking a highly skilled Senior Data Engineering Lead to join our team. In this role, you will be responsible for leading the development and implementation of data analytics solutions using Python.Key Responsibilities:Lead the design, development, and deployment of data analytics solutions using Python.Collaborate with...

  • Lead Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Expert WantedWe are looking for a highly skilled professional to lead our data engineering efforts.About the RoleThe ideal candidate will have extensive experience with big data technologies, including Spark, Hadoop, and Hive. They should also have hands-on expertise with Python and Bash scripts, as well as a solid understanding of SQL and data...

  • FID Federal Risk Applications Data Engineer

    15 hours ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 341951NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties:...

  • Data Engineering Lead

    1 week ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a seasoned Data Engineer to spearhead the implementation of infrastructure via code and provide strategic advice on Azure technology advancements.Main Responsibilities:Design, develop, and deploy infrastructure using code and provide expert guidance on Azure technology advancements.Integrate and automate standardized Azure...

  • Senior Data Engineering Lead

    2 weeks ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    We are seeking a seasoned technical professional to spearhead data engineering initiatives.Key Responsibilities:Drive the development and implementation of comprehensive data platforms, ensuring alignment with strategic objectives.Collaborate with cross-functional teams to design and deliver high-quality solutions, leveraging Agile methodologies and sprint...

Leading Data Engineer

3 weeks ago

Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878
Senior Data Engineer

As a Senior Data Engineer, you will be responsible for designing and developing scalable data pipelines that integrate with our cloud-based infrastructure. You will work closely with cross-functional teams to identify business requirements and develop technical solutions that meet those needs.

Job Responsibilities:
  • Design and develop fault-tolerant data pipelines using Apache Spark and Python (PySpark)
  • Develop efficient SQL queries with Python and Hive to handle large data sets in big-data environments
  • Collaborate with the Enterprise Data & Analytics Architect and Engineering practice leads to ensure adherence to best practices and design principles
  • Work closely with business owners to define key business requirements and convert them into user stories with required technical specifications
Requirements:
  • Proven experience in designing and developing data pipelines for data ingestion or transformation using PySpark/Spark SQL in AWS cloud
  • Advanced experience in writing and optimizing efficient SQL queries with Python and Hive handling large data sets in big-data environments
  • Experience in debugging, tuning, and optimizing PySpark data pipelines
  • Good knowledge of Pyspark data frames, joins, caching, memory management, partitioning, parallelism, etc.
Desirable Skills:
  • Experience in data modeling
  • Hands-on experience creating workflows on scheduling tools like Autosys, CA Workload Automation
  • Proficiency in using SDKs for interacting with native AWS services