Senior Data Engineer

3 weeks ago


Greater Bengaluru Area, India CodeVyasa Full time

Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.


There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).


Company Background - We are a multinational software company that is growing at a fast pace. We have offices in Florida & New Delhi. Our clientele spreads across the US, Australia & APAC. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q4 2024.


Key Responsibilities

  • Design, implement, and maintain data processing pipelines using PySpark for both streaming and batch processing.
  • Develop and optimize ETL workflows on AWS EMR and AWS Glue.
  • Utilize SQL and Hive for data transformation and querying.
  • Collaborate with data scientists and analysts to ensure data quality and accessibility for analytics and machine learning applications.
  • Monitor data pipelines, troubleshoot issues, and optimize performance across all stages of data processing.
  • Contribute to data architecture decisions and improve data infrastructure to support large-scale processing needs.

Required Skills

  • SQL: Proficient in complex queries, data manipulation, and data extraction.
  • PySpark: Expertise in using PySpark for both streaming and batch data processing.
  • AWS EMR & Glue: Hands-on experience in setting up and managing data workflows on AWS EMR and Glue.
  • Hive: Strong working knowledge of Hive for querying and managing data in a distributed environment.

Preferred Skills

  • Apache Kafka: Experience with Kafka for real-time data streaming is a plus.
  • Amazon Redshift: Knowledge of Amazon Redshift for data warehousing and analytics is advantageous.


Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proven track record of 7+years in data engineering, with a focus on large-scale data processing and data pipeline development.
  • Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.



Here is what we have on offer for you:

  • Glassdoor's rating of 4.8
  • Free healthcare
  • Laser-sharp focus on upskilling our employees
  • Diverse & Inclusive teams
  • Industry-par compensation & benefits
  • Great work-life balance


  • Senior Data Engineer

    4 weeks ago


    Greater Kolkata Area, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    3 weeks ago


    Greater Bengaluru Area, India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that...

  • Senior Data Engineer

    1 month ago


    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    1 month ago


    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    3 weeks ago


    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Cloud Engineer

    18 hours ago


    Greater Bengaluru Area, India Tata Consultancy Services Full time

    Job Title:Senior Cloud Engineer - Data Warehousing and AnalyticsCompany Overview:Tata Consultancy Services is a leading global technology consulting and business solutions organization. We are seeking a Senior Cloud Engineer to join our team.Salary:The estimated annual salary for this position is $120,000-$180,000, depending on experience and...

  • Senior Data Engineer

    1 month ago


    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Senior Data Analyst

    1 week ago


    Greater Bengaluru Area, India Initus HR Consulting Pvt.Ltd-USA company Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer ,Data Analyst Experience: 7-12 YearsLocation: BangaloreEmployment Type: Full-TimeSummary:We are looking for a highly skilled Senior Data Engineer with 7-12 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Analyst

    1 week ago


    Greater Bengaluru Area, India Initus HR Consulting Pvt.Ltd-USA company Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer ,Data Analyst Experience: 7-12 Years Location: Bangalore Employment Type: Full-Time Summary: We are looking for a highly skilled Senior Data Engineer with 7-12 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services...


  • Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    1 month ago


    Bengaluru, India NTT DATA Services Full time

    Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job PurposeThe senior data...


  • Greater Bengaluru Area, India Tata Consultancy Services Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Tata Consultancy Services.With 5-9 years of experience, you will be responsible for developing and maintaining innovative Azure solutions using Databricks notebooks with Pyspark.Your key responsibilities will include:Ensuring data is cleansed, mapped, transformed, and optimized for...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Senior Data Engineer

    3 weeks ago


    Greater Bengaluru Area, India Applicantz Full time

    THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is...


  • Greater Bengaluru Area, India CodeVyasa Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at CodeVyasa.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:Data Pipeline Development: Design, implement, and...


  • Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...


  • Greater Bengaluru Area, India Bryckel AI Full time

    We are seeking a highly skilled Senior Data Indexing Engineer to lead the development and optimization of our AI-powered data retrieval and knowledge management systems at Bryckel AI.About Us:Bryckel AI is a pioneering company that specializes in cutting-edge AI solutions. Our mission is to harness the power of artificial intelligence to revolutionize the...


  • Greater Bengaluru Area, India Calsoft Full time

    About Calsoft: We are a leading provider of technology solutions to top companies in the world. Our team is passionate about leveraging data science and engineering methodologies to drive business growth.Salary Range: ₹ 15,00,000 - ₹ 25,00,000 per annum (depending on experience)Job Description:We are seeking an experienced Senior Data Analytics Expert to...

  • Data Engineer

    4 days ago


    Greater Hyderabad Area, India Insight Global Full time

    JOB DESCRIPTIONOur Tech clients within the Data & Analytics (DNA) Organization is seeking two experienced Senior Data Engineers to join our team in India. These individuals will play a crucial role in building analytical data assets and leveraging the modern data stack to support a new program, the modernization of internal data estate and analytics. The...

  • Data Systems Engineer

    4 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...