Senior Data Engineer

2 weeks ago


India Quantiphi Full time

About Company

Quantiphi is an award-winning applied AI and data science software and services company driven by the desire to solve transformational problems at the heart of the business.

Company highlights:

❖ Quantiphi has seen 2.5x growth YoY since its inception in 2013.

❖ Winner of the "Machine Learning Partner of the Year" award from Google for two consecutive years and 2018.

❖ Winner of the "Social Impact Partner of the Year" award from Google for 2019.

❖ Headquartered in Boston, with 700+ data science professionals across different offices.

Job title Senior Data Engineer

Location Mumbai / Bangalore / Trivandrum

Experience 3 - 6 years

Overview

We are looking for a candidate, who will be responsible for designing, building, and maintaining data pipelines and data infrastructure on the Google Cloud Platform (GCP). You will be collaborating with cross-functional teams to understand data requirements, implement scalable data solutions, and ensure the efficient and reliable processing and storage of data. Expertise in GCP services and data engineering principles will be crucial in delivering high-quality and performant data solutions.

Roles and Responsibilities

➔ Collaborate with stakeholders, data architects, and other team members to understand

data requirements and translate them into scalable data engineering solutions on GCP.

➔ Design and develop data pipelines, ETL (Extract, Transform, Load) processes, and data

integration workflows using GCP services such as Dataflow, Pub/Sub, BigQuery, Cloud

Storage, and others.

➔ Implement data transformation and data cleansing operations to ensure data quality and

consistency throughout the data pipelines.

➔ Build and manage data storage systems, including databases, data lakes, and data

warehouses, leveraging GCP services like BigQuery, Cloud Storage, and Cloud Spanner.

➔ Optimize data pipelines and data storage systems for performance, scalability, and

cost-effectiveness, considering factors such as data volume, velocity, variety, and quality.

➔ Implement data security measures and ensure compliance with data governance and privacy policies.

➔ Monitor, troubleshoot, and optimize data pipelines and data infrastructure to ensure the availability, reliability, and efficiency of data processing.

➔ Collaborate with DevOps teams to design and implement monitoring, logging, and

alerting solutions for data pipelines and infrastructure.

Skillsets Requirements

➔ Have at least 3 years of experience in the Google Cloud Platform (especially Big Query )

➔ Experience with Java, Python, and Google Cloud SDK & API Scripting.

➔ Experience with GCP Migration activities will be an added advantage.

➔ Strong knowledge of Google Cloud Platform (GCP) services and technologies, including

but not limited to Dataflow, Pub/Sub, BigQuery, Cloud Storage, Container, Docker, and

Cloud Spanner.

➔ Proficiency in programming languages such as Python, SQL, or Java for data processing and scripting tasks.

➔ Experience in designing and building data pipelines and ETL processes using GCP data engineering tools.

➔ Familiarity with data modeling, schema design, and data integration techniques.

➔ Knowledge of data warehousing concepts and experience with data warehouse solutions like BigQuery.

➔ Experience with version control systems, CI/CD pipelines, and infrastructure automation tools like Git, Jenkins, or Terraform.

Soft Skills

➔ Excellent verbal and written communication skills.

➔ Attention to detail

➔ Strong problem-solving abilities

➔ The ability to adapt to changing requirements and technologies ensuring accuracy and precision in data analysis, report design, and development


  • Operations Specialist

    2 weeks ago


    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Senior Data Engineer

    4 weeks ago


    india RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...


  • India K2 Data & Analytics Full time

    Job Title: Senior Machine Learning EngineerWe are currently seeking a highly motivated Senior Machine Learning Engineer with extensive experience exceeding five years to join our dynamic team dedicated to leading the way in innovative Video Ad Data solutions.The ideal candidate for this position should possess a strong knowledge of machine learning...

  • Senior Data Engineer

    2 weeks ago


    India Next-Link Full time

    Job Description Senior Data Engineer - Brussels - 12 moisOne of our important clients is currently looking for a Senior Data Engineer for a 12-month contract in Brussels.We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work...

  • Senior Data Engineer

    2 weeks ago


    India Mopid Full time

    Senior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...

  • Senior Data Engineer

    2 weeks ago


    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    2 weeks ago


    India Rigel Networks Pvt. Ltd. Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Senior Data Engineer

    1 month ago


    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    4 weeks ago


    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    2 weeks ago


    India Accelerant Full time

    Job Type: ContractLocation: IndiaExperience: 8+ yearsRequired Experience:Hands-on experience with Fivetran, AWS S3, DBT, Redshift, and TableauRole Description:We are looking for a Senior Data Engineer to join our team at Accelerant. As a Senior Data Engineer, you will play a crucial role in data modeling, ETL processes, data warehousing, and data analytics....

  • Senior Data Engineer

    2 weeks ago


    India Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...

  • Senior Data Engineer

    1 month ago


    india PrimEra Medical Technologies Full time

    Job Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...

  • Senior Engineer

    5 days ago


    india NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Senior Data Engineer

    2 weeks ago


    India Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    4 weeks ago


    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    2 months ago


    india Next-Link Full time

    Job Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...

  • Senior Data Engineer

    2 weeks ago


    India OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer.Senior Data Engineer (Irving, Tx)JOB DESCRIPTION:• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and...

  • Senior Data Engineer

    2 weeks ago


    india MindBrain Full time

    Company Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...

  • Senior Data Engineer

    2 weeks ago


    India SourceBae Full time

    Senior Data Engineer Exp-6+Yrs Shift Time : 2 PM - 11 PM As a Senior Data Engineer , you will:  Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements  Develop systems that ingest, cleanse and normalize diverse datasets, develop data...

  • Senior Data Engineer

    2 weeks ago


    India Apptad Inc. Full time

    Role - Senior Data EngineerExp - 7+ yrsLocation - Bangalore/Hyderabad* Proficient in Python to design, develop, and maintain scalable data pipelines and ETL processes. * Has knowledge in pulling data using R via API's.* Extensive experience in building and optimizing data architectures, as well as strong skills in data modeling and SQL. * Capable enough to...