Senior Data Engineering Manager

1 month ago

Pune, India SMARTWORK IT SERVICES Full time

Job Title : Senior Data Engineering Manager - GCP

Experience Required : 14-16 years (Level 5 - Senior Manager)

Locations : Bangalore, Chennai, Kolkata, Gurugram, Pune

Mandatory Skills : GCP, GCS, BigQuery, SQL, Data Flow, DataProc with PySpark, Pub/Sub, Airflow, Python, Spark

Job Description :

We are looking for an analytical, big-picture thinker who is driven to enhance and further the client's mission by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. As a Data Engineer, you will lead the engagement to focus on implementing both low-level, innovative solutions, as well as the day-to-day tactics that drive efficiency, effectiveness, and value.

You will play a critical role in creating and analyzing deliverables to provide critical content for fact-based decision-making, facilitation, and achievement of successful collaboration with business stakeholders. You will analyze, design, and develop best practices for business changes through technology solutions.

Experience 14-16 years in IT or professional services in IT delivery or large-scale IT analytics Requirements :


- Have implemented and architected solutions on Google Cloud Platform using GCP components.


- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end-to-end data pipelines.


- Experience in some of the following: Python, Hadoop, Spark, SQL, BigQuery, BigTable, Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.


- Experience programming in Java, Python, etc.


- Expertise in at least two of these technologies: Relational Databases, Analytical Databases, NoSQL databases.


- Certified Google Professional Data Engineer or Solution Architect is a major advantage.


Roles & Responsibilities :


- Expert knowledge of Google Cloud Platform; experience with other cloud platforms is a plus.


- Expert in SQL development.


- Expertise in building data integration and preparation tools using cloud technologies (like Snaplogic,

Google Dataflow, Cloud Dataprep, Python, etc.).


- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end-to-end data pipelines.


- Experience in Python, Hadoop, Spark, SQL, BigQuery, BigTable, Cloud Storage, Datastore, Spanner, Cloud

SQL, Machine Learning.


- Ability to identify downstream implications of data loads/migration (e.g., data quality, regulatory, etc.).


- Implement data pipelines to automate data source ingestion, transformation, and augmentation, and

provide best practices for pipeline operations.


- Capable of working in a rapidly changing business environment and enabling simplified user access to

massive data by building scalable data solutions.


- Advanced SQL writing and experience in data mining (SQL, ETL, data warehousing, etc.) and using databases in a business environment with complex datasets.


(ref:hirist.tech)

  • Senior Data Engineer

    6 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Protection Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...

  • Data Architect and Engineer Senior Specialist

    1 month ago

    Pune, Maharashtra, India NTT DATA Full time

    Job SummaryWe are seeking a skilled Systems Integration Senior Specialist to join our team in India. The ideal candidate will have a Master's or Bachelor's degree in computer science or a related field and at least 8 years of experience in implementing data applications and big data platforms.Expertise in designing, engineering, and deploying data ingestion,...

  • Senior Data Scientist

    6 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Analytics Engineer

    1 day ago

    Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Senior Mulesoft Engineer

    14 hours ago

    Pune, Maharashtra, India Capgemini Engineering Full time

    At Capgemini Engineering, we're seeking a highly skilled Mule Developer to join our team. As a Senior Mulesoft Engineer, you'll play a critical role in designing and implementing enterprise-level integration solutions using MuleSoft.With 10 years of experience in software development, you'll have a strong background in developing applications with Batch...

  • Senior Quality Engineer

    3 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 302026 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Senior Quality...

  • Data Engineer

    1 month ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 297728 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job Title Developer/ Data...

  • Senior Network Engineer and Technical Innovator

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Network Engineer to join our team. As a key member of our network management services, you will be responsible for ensuring the smooth operation of our clients' IT infrastructure.Your Day at NTT DATAThe role of a Networking Managed Services Engineer (L2) involves proactively monitoring, identifying,...

  • Senior Data Engineer

    4 weeks ago

    pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior data engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling...

  • Senior data engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India PubMatic Full time

    Join PubMatic as a Senior Data Engineer and be part of our team developing cutting-edge data analytics solutions. We are looking for an experienced professional to join our engineering team.About the RoleWe are seeking a skilled Senior Data Engineer to lead the development of our data analytics platform. The ideal candidate will have experience in big data...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Principal Data Architect

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data EngineerAs a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Antal International Full time

    Senior Software Engineer - Data Engineer As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep...

  • Data Science Expert

    1 month ago

    Pune, Maharashtra, India Data Axle Full time

    About the Role:Data Axle Inc. is a leading provider of data, marketing solutions, and research services. We are seeking an experienced Senior Data Scientist to join our Core Data Science team.The successful candidate will have a strong background in machine learning, with a proven track record of designing, building, and deploying impactful data...

  • Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...