Senior Data Engineer

3 weeks ago

Bangalore, India CodeVyasa Full time

Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.

There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).

Company Background - We are a multinational software company that is growing at a fast pace. We have offices in Florida & New Delhi. Our clientele spreads across the US, Australia & APAC. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q4 2024.

Key Responsibilities

  • Design, implement, and maintain data processing pipelines using PySpark for both streaming and batch processing.
  • Develop and optimize ETL workflows on AWS EMR and AWS Glue .
  • Utilize SQL and Hive for data transformation and querying.
  • Collaborate with data scientists and analysts to ensure data quality and accessibility for analytics and machine learning applications.
  • Monitor data pipelines, troubleshoot issues, and optimize performance across all stages of data processing.
  • Contribute to data architecture decisions and improve data infrastructure to support large-scale processing needs.

Required Skills

  • SQL : Proficient in complex queries, data manipulation, and data extraction.
  • PySpark : Expertise in using PySpark for both streaming and batch data processing.
  • AWS EMR & Glue : Hands-on experience in setting up and managing data workflows on AWS EMR and Glue.
  • Hive : Strong working knowledge of Hive for querying and managing data in a distributed environment.

Preferred Skills

  • Apache Kafka : Experience with Kafka for real-time data streaming is a plus.
  • Amazon Redshift : Knowledge of Amazon Redshift for data warehousing and analytics is advantageous.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proven track record of 7+years in data engineering, with a focus on large-scale data processing and data pipeline development.
  • Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.

Here is what we have on offer for you:

  • Glassdoor's rating of 4.8
  • Free healthcare
  • Laser-sharp focus on upskilling our employees
  • Diverse & Inclusive teams
  • Industry-par compensation & benefits
  • Great work-life balance

  • Data engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of...

  • Senior Data Engineer

    1 month ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...

  • Senior Data Engineer

    1 month ago

    Bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF),...

  • Senior Data Engineer

    1 month ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-10 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Markets, Investment banking domain. --- Summary: We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server...

  • Senior Data Engineer

    1 month ago

    bangalore, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data EngineerExperience: 8-10 YearsLocation: BangaloreEmployment Type: Full-TimeMust have experience in Capital Markets, Investment banking domain.---Summary:We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Senior Data Engineer

    2 months ago

    Bangalore, India Talent Corner HR Services Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a skilled and experienced Data Engineer to join our dynamic team at Talent Corner HR Services. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure, pipelines, and systems.Key Responsibilities:Lead the design and implementation of...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Capco Full time

    Greetings from Capco... We are hiring for Senior Data Engineer for Bangalore Location. Qualifications: Proven 5-8 years of experience as a Senior Data Engineer or similar role. • Experience with big data tools: Hadoop, Spark, Scala, Hive, etc. • Expert level SQL skills for data manipulation (DML) and validation (DB2). • Experience with...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Capco Full time

    Greetings from Capco...We are hiring for Senior Data Engineer for Bangalore Location.Qualifications:Proven 5-8 years of experience as a Senior Data Engineer or similar role.• Experience with big data tools: Hadoop, Spark, Scala, Hive, etc.• Expert level SQL skills for data manipulation (DML) and validation (DB2).• Experience with data pipeline and...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Synechron Full time

    Good-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days . About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Senior data engineer

    3 days ago

    Bangalore, India Publicis Sapient Full time

    Senior Associate Data Engineering Level 2 The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...