Senior Data Engineer

3 days ago


Any Location, IN Quantumbricks Full time

We are seeking a highly motivated and experienced Sr. Data Engineer to join our growing team and play a critical role in designing, building, and maintaining our data pipelines on Google Cloud Platform (GCP).

You will leverage your in-depth knowledge of GCP data services and strong data engineering principles to develop scalable, efficient, and secure solutions that transform raw data into actionable insights for our business.

Responsibilities :

- Design, develop, and implement data pipelines for ingesting, transforming, and loading data at scale using GCP services like Cloud Storage, Pub/Sub, Dataflow, and BigQuery.

- Optimize data pipelines for performance and cost-efficiency, leveraging techniques like data partitioning, clustering, and materialized views in BigQuery.

- Design and implement data models within BigQuery to ensure data consistency, accuracy, and efficient querying.

- Automate data processing workflows using tools like Cloud Scheduler and Airflow.

- Develop and maintain data quality checks and monitoring dashboards to ensure data integrity throughout the pipeline.

- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into technical specifications.

- Implement best practices for data security and access control within GCP.

- Stay up-to-date with the latest advancements in GCP data services and data engineering trends.


- Participate in code reviews and knowledge sharing within the engineering team.

Qualifications :

- 10+ years of experience in data engineering or a related field.

- Proven experience with cloud platforms, specifically Google Cloud Platform (GCP).

- In-depth knowledge of GCP data services including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, and Cloud Scheduler.

- Strong proficiency in SQL for data querying and manipulation.

- Experience with data modeling techniques and best practices.

-Familiarity with scripting languages like Python for data manipulation and automation tasks (a plus).

- Experience with data pipeline orchestration tools like Airflow (a plus).

- Excellent understanding of data security principles and practices.

- Strong communication and collaboration skills to work effectively with cross-functional teams.

- Ability to independently manage projects, meet deadlines, and prioritize tasks effectively.

- Problem-solving skills and a passion for building innovative data solutions

(ref:hirist.tech)

  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN Innova ESI Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This is a remote-first position, offering you the flexibility to work from anywhere while collaborating effectively with colleagues. In this role, you will play a key role in the entire data lifecycle, from designing and implementing data pipelines...


  • Any Location, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview : As a Senior Data Engineer, you will be responsible for architecting,...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...


  • Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Data Engineer

    4 weeks ago


    Chennai/Any Location, IN mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek a...

  • Senior Data Engineer

    1 month ago


    Chennai/Any Location, IN mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek a...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...


  • Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...


  • Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    2 months ago


    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    1 month ago


    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    4 weeks ago


    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    2 months ago


    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...


  • Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    Job Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...

  • Senior Data Engineer

    2 weeks ago


    Any Location, IN Narwal Full time

    Job Description : Narwal, with its Global Delivery Model, strategically expands its reach across North America, the United Kingdom, and an offshore development center in India. Delivery cutting edge AI, Data, Cloud and Quality Engineering solutions and consistently surpassing expectations,Narwal has achieved remarkable triple-digit growth rates year after...


  • Any Location, IN Mobile Programming LLC Full time

    Job Description : Mobile Programming is urgently hiring for a Data visualization Engineer who is responsible for the graphical representation of information and data. To be successful in this field, you must have knowledge of visual elements like charts, graphs, and maps, data visualization tools provide an accessible way to see and understand trends,...