Senior Data Engineer

2 months ago


Bangalore Metropolitan Area, India CodeVyasa Full time

Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.


There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).


Company Background - We are a multinational software company that is growing at a fast pace. We have offices in Florida & New Delhi. Our clientele spreads across the US, Australia & APAC. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q4 2024.


Key Responsibilities

  • Design, implement, and maintain data processing pipelines using PySpark for both streaming and batch processing.
  • Develop and optimize ETL workflows on AWS EMR and AWS Glue.
  • Utilize SQL and Hive for data transformation and querying.
  • Collaborate with data scientists and analysts to ensure data quality and accessibility for analytics and machine learning applications.
  • Monitor data pipelines, troubleshoot issues, and optimize performance across all stages of data processing.
  • Contribute to data architecture decisions and improve data infrastructure to support large-scale processing needs.

Required Skills

  • SQL: Proficient in complex queries, data manipulation, and data extraction.
  • PySpark: Expertise in using PySpark for both streaming and batch data processing.
  • AWS EMR & Glue: Hands-on experience in setting up and managing data workflows on AWS EMR and Glue.
  • Hive: Strong working knowledge of Hive for querying and managing data in a distributed environment.

Preferred Skills

  • Apache Kafka: Experience with Kafka for real-time data streaming is a plus.
  • Amazon Redshift: Knowledge of Amazon Redshift for data warehousing and analytics is advantageous.


Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proven track record of 7-12 years in data engineering, with a focus on large-scale data processing and data pipeline development.
  • Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.



Here is what we have on offer for you:

  • Glassdoor's rating of 4.8
  • Free healthcare
  • Laser-sharp focus on upskilling our employees
  • Diverse & Inclusive teams
  • Industry-par compensation & benefits
  • Great work-life balance


  • Senior Data Engineer

    12 hours ago


    Bangalore Metropolitan Area, India Apparel Group Full time

    Hello Everyone,I am currently seeking Data Engineer/Senior Data Engineer who will be part of Data science team and will be working from Bangalore office, this is urgent requirement so only apply if you can Join with short notice, @ Working as Data Engineer with current designation will be preferred, and maximum budget is upto 24lpa Experience needed is...

  • Senior Data Analyst

    4 weeks ago


    Bangalore Metropolitan Area, India Initus HR Consulting Pvt.Ltd-USA company Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer ,Data Analyst Experience: 7-12 YearsLocation: BangaloreEmployment Type: Full-TimeSummary:We are looking for a highly skilled Senior Data Engineer with 7-12 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India Groww Full time

    About GrowwWe are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Each day, we help millions of customers take charge of their financial journey.Customer obsession is in our DNA. Every product, every design, every algorithm down to the tiniest detail is executed keeping the...

  • Senior Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Applicantz Full time

    THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is...


  • Bangalore Metropolitan Area, India Recro Full time

    Are you a skilled developer looking for a challenging role that combines data and machine learning expertise?At Recro, we empower talented developers by providing them with relevant experience at fast-growing startups based on technical competencies and aspirations. We strive to create optimal business outcomes for high-growth startups.About the RoleWe are...

  • Data Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Capgemini Full time

    Location: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...

  • Data Engineer

    2 weeks ago


    Bangalore Metropolitan Area, India Recro Full time

    Must-Have Skills & Qualifications:Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.•5+ years of experience in data engineering or a related role.•Proficiency in Apache Airflow for workflow scheduling and management.•Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and...

  • Data Engineer

    2 months ago


    Bangalore Metropolitan Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Senior Data Developer

    2 weeks ago


    Bangalore Metropolitan Area, India Tata Consultancy Services Full time

    TCS is a global leader in IT services and consulting, serving clients across various industries.We are seeking a highly skilled Senior Data Developer to join our team. As a Senior Data Developer, you will play a key role in designing, developing, and implementing big data solutions to drive business growth and improve decision-making.The successful candidate...

  • Azure Data Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Torry Harris Integration Solutions Full time

    Are you an experienced data engineer looking for a new challenge? If so, Torry Harris is seeking a talented Azure Data Engineer to join our team and help drive our data engineering efforts to the next level.As an Azure Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining cloud-based data solutions using Azure...


  • Bangalore Metropolitan Area, India Trianz Full time

    Responsibilities -Architectural Design: Architect secure, scalable, highly performant data engineering and management solutions, including data warehouses, data lake, ELT / ETL, and real-time data engineering/pipeline solutions.Support Principal Data Architect in defining and maintaining Practice reference data engineering and data management...


  • Bangalore Metropolitan Area, India Prometheus Consulting Services. Full time

    Hi Folks,We are currently hiring for an International Retail Organization.Role: Senior Data Analyst-EcommerceExperience: 4+ YearsLocation-BangaloreEducation-Bachelor’s Degree in engineering, Business, marketing, finance or related field.Roles & Responsibilities:Core Responsibilities:The BA team comprises business intelligence and digital consulting...

  • Hevo Data

    21 hours ago


    Bangalore/Bangalore, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Senior MLOps Engineer

    2 months ago


    Bangalore Metropolitan Area, India a Snaphyre Client Full time

    Our client is a pioneering AgriTech startup that combines satellite data, artificial intelligence, and grid technology to tackle critical challenges in agriculture and the environment. Their mission is to create value by visualizing agricultural land, enabling sustainable farming practices, reducing carbon emissions, and driving positive change for farmers,...

  • Senior MLOps Engineer

    2 months ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OfferWork with a well-funded AgriTech startup tackling critical challenges in Agriculture and the EnvironmentPlay a pivotal role in shaping a high-impact product driving the future of AgricultureWork with state-of-the-art technologies in AI, remote sensing, and data analytics The JobAs a skilled and committed Senior MLOps Engineer, you will oversee the...

  • Senior Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Luxoft Full time

    We've been engaged by a large UK Based Investment Bank in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .RESPONSIBILITIES• Ensuring quality service output, submitted in a timely manner and communicated effectively• Continuous...

  • Senior Data Engineer

    4 months ago


    Bangalore Metropolitan Area, India Tredence Inc. Full time

    Role & responsibilitiesWorking experience in Snowflake; use of Snow SQL CLI, Snow Pipe creation of custom functions and Snowflake stored producers, schema modelling, performance tuning etc.Expertise in Snowflake data modelling, ELT using Snowflake SQL, Snowflake Task Orchestration implementing complex stored Procedures and standard DWH and ETL...

  • Data Scientist

    2 weeks ago


    Bangalore Metropolitan Area, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Data ScientistRequired Skillset: 5+ Years, including the experience in designing and building of analytics use cases and productionization of the model for a quantified business value, for a minimum of 5 engagements Location: Bangalore/Pune/Chennai/Noida/Mumbai/HYD/IndoreExperience Range: 7-15 yearsJob DescriptionMust-Have**A...

  • Data QA Engineer

    2 months ago


    Bangalore Metropolitan Area, India Luxoft Full time

    LocationsBengaluru, Chennai, PuneProject descriptionWorking within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.ResponsibilitiesAnalyse and document test data , results, and recommendations.Perform functional and...


  • Bangalore Metropolitan Area, India Aventra Group Full time

    C++ Technical Lead & Senior Software Engineer role at Aventra GroupJob DescriptionCompany DescriptionAventra Group is a boutique IT consultancy specializing in Enterprise Digital Solutions, Application Development, and Managed Services. With offices and delivery centers across Malaysia, Singapore, India, Vietnam, UAE, and the USA, Aventra Group combines...