Senior Data Engineer

1 month ago


Bangalore Urban, India Quantiphi Full time

Role & Responsibilities:

As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be comfortable working with extremely abstract and ambiguous requirements. Must be capable of handling extremely changing business environments with the capability to wear multiple hats at once. Must be able to consult improvisations in various

old school data engineering methods. Should be a very good team player.


  • Design and Develop Data Pipelines: Create robust and efficient (infrastructure and cost efficient) data pipelines on GCP to facilitate the seamless flow of data.
  • Cross-functional Collaboration: Collaborate with cross-functional teams/stakeholders to understand data requirements and deliver high-quality data solutions in the least amount of time.
  • Collaborate with Data Architects: Work closely with client and team data architects to implement data models and pipelines and ensure their integration with GCP services.
  • Optimize Data Storage Solutions: Utilize BigQuery, Cloud Storage, and other appropriate GCP services to optimize data storage solutions.
  • Troubleshooting: Proactively troubleshoot data and pipeline-related issues to ensure smooth operation and reliability.



Skills required:

  • Migration of DAGs from AWS to GCP by handling version upgrade and architectural changes
  • Configuration changes for Hive jobs and spark jobs (Python, Scala) migration based on the cloud environment
  • Collaborate with development and operations teams to streamline the deployment process and ensure continuous integration and continuous deployment practices.
  • Define and enforce best practices for version control, branching, and code promotion in collaboration with development teams.
  • Work closely with cross-functional teams to troubleshoot and resolve deployment issues and optimize release processes.


Good to have:

  • Knowledge of LMS and education sector
  • Working knowledge of IICS


  • Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL,...


  • Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior Data Engineer

    1 month ago


    Bangalore Urban, India AceNet Full time

    Job Overview:We are seeking a highly skilled Senior Data Engineer with specialized expertise in Snowflake to join our growing team. The ideal candidate will have exceptional SQL skills, coupled with experience in DBT and Fivetran. This role involves designing and implementing scalable data pipelines, optimizing performance within Snowflake environments, and...

  • Senior Data Engineer

    1 month ago


    Bangalore Urban, India AceNet Full time

    Job Overview: We are seeking a highly skilled Senior Data Engineer with specialized expertise in Snowflake to join our growing team. The ideal candidate will have exceptional SQL skills, coupled with experience in DBT and Fivetran. This role involves designing and implementing scalable data pipelines, optimizing performance within Snowflake environments,...

  • Data Engineer

    2 months ago


    Bangalore Urban, India Acuity Knowledge Partners Full time

    We are looking for a senior data engineer who will help us source, validate, and manage financial data using state-of-the-art data mining algorithms. The role involves leveraging the latest data mining techniques, designing validation engines, error monitoring, and conducting root cause analysis. The candidate will also be responsible for statistical...

  • Senior Data Engineer

    1 month ago


    Bangalore Urban, India Quantiphi Full time

    Role & Responsibilities: As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be comfortable...

  • Senior Data Engineer

    1 month ago


    Bangalore Urban, India Quantiphi Full time

    Role & Responsibilities: As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be...

  • Senior Data Engineer

    2 weeks ago


    Bangalore Urban, India MathCo Full time

    TheMathCompany or MathCo® is a global Enterprise AI and Analytics company trusted for data-driven decision-making by leading Fortune 500 and Global 2000 enterprises. Founded in 2016, MathCo builds custom AI and advanced analytics solutions focused on enterprise problem-solving through its innovative hybrid model. NucliOS, MathCo’s proprietary platform...

  • Azure Data Engineer

    3 weeks ago


    Bangalore Urban, India Hexaware Technologies Full time

    Experience: 6-9 yrs Work location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 days Senior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, India Junglee Games India Private Limited Full time

    Job Title: Senior Data EngineerDescription:As a Senior Data Engineer at Junglee Games India Private Limited, you will play a key role in evolving the design and architecture of our data infrastructure. You will be responsible for writing code primarily in Spark, Python, and/or Scala, and developing streaming applications like Spark structured streaming and...

  • Senior Data Engineer

    1 month ago


    Bangalore, India ADVANSOFT Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Advansoft. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop complex data pipelines using PySpark,...

  • Senior data engineer

    1 month ago


    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    3 months ago


    Bangalore Urban, India CoffeeBeans Full time

    Founded in the year 2017, CoffeeBeans specializes in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses...


  • Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Senior Data Engineer

    9 hours ago


    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Data engineer

    1 month ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 weeks ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 weeks ago


    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago


    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Senior Data Engineer

    1 month ago


    Bangalore, India Aeries Technology Group Full time

    Job Title: Senior Data EngineerJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Aeries Technology Group. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems.Key Responsibilities:Collaborate with cross-functional teams to understand data...