Senior Data Engineer

2 months ago


Bangalore Metropolitan Area, India Applicantz Full time

THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.


Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is respected. Integrity, experience, honesty, people, humanity, and passion for excellence are some other adjectives that define this global technology leader.


Responsibilities:

  • Deploy and configure Apache Spark clusters on AWS (particularly EKS), optimizing for performance, resource allocation, and scalability.
  • Develop, automate, and support robust and reliable Spark data pipelines, focusing on high performance and low latency.
  • Design and implement highly optimized queries to improve data processing efficiency, streamline analysis, minimize latency, and enhance overall system performance.
  • Collaborate to make the Data Platform an effective, scalable, and resilient system.
  • Gather requirements from stakeholders, prioritize work, and document technical solutions clearly and effectively.
  • Engage with data engineers, data scientists, product managers, and internal stakeholders to align project goals and implementations.
  • Contribute to a team culture that values quality, robustness, and scalability while fostering initiatives and innovation​


Minimum Qualifications:

  • 5+ years of data processing experience in large cloud-based infrastructure (AWS is must)
  • Hands-on software development experience in Python, with strong proficiency in Py Spark for data engineering tasks and data pipeline development
  • Expert understanding of SQL, dimensional modeling, and analytical data warehouses, such as Snowflake
  • Understanding of Data Engineering best practices for medium to large scale production workloads
  • Expertise with data pipeline orchestration tools, such as Airflow
  • Familiar with processing semi-structured file formats such as json or parquet
  • Team player with good communication skills
  • Problem solver with excellent written and interpersonal skills
  • Strong problem-solving skills
  • Ability to learn new technical skills
  • Bachelor’s degree in Computer Science, Data Science, or related fields


Preferred Qualifications:

  • Experience with Jinja, Shell scripting, DBT
  • Developing in Cloud platform using serverless technologies such as glue, lambda, EMR is a plus.
  • Experience with remote development using AWS SDK is a plus
  • Experience with ELT pipelines - DBT
  • REST API design and implementation
  • Familiarity with containers and infrastructure-as-code principles
  • Experience with automation frameworks - Git, Jenkins, and Terraform

  • Senior Data Engineer

    2 weeks ago


    Bangalore Metropolitan Area, India Apparel Group Full time

    Hello Everyone,I am currently seeking Data Engineer/Senior Data Engineer who will be part of Data science team and will be working from Bangalore office, this is urgent requirement so only apply if you can Join with short notice, @ Working as Data Engineer with current designation will be preferred, and maximum budget is upto 24lpa Experience needed is...


  • Bangalore Metropolitan Area, India NeoLotex Business Solutions Private Limited Full time

    We are hiring for a global technology company, market leader in providing innovative digital solutions.Job Title: Lead / Sr. Data Engineer – Implementation SpecialistExperience Level: 7-12 YrsWork Location:Bangalore* **Data Integration & Engineering:** Design, develop, and maintain robust data pipelines, connecting disparate systems and optimizing data...

  • Senior Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Groww Full time

    About GrowwWe are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Each day, we help millions of customers take charge of their financial journey.Customer obsession is in our DNA. Every product, every design, every algorithm down to the tiniest detail is executed keeping the...

  • GCP Data Engineer

    2 days ago


    Bangalore Metropolitan Area, India EliteRecruitments Full time

    Location: BangaloreJob Summary:We are seeking a highly skilled Senior Google BigQuery Data Engineer to lead the design, development,and optimization of our data platform. The ideal candidate will have a deep understanding of BigQuery'sarchitecture, capabilities, and best practices, including columnar storage, nested and repeated fields, andseparation of...

  • Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Capgemini Full time

    Location: PAN IndiaJob Description (GCP Data Engineer):• Experience in GCP Data Engineering.• Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud.• Should have worked on handling big data.• Strong communication skills.• experience in Agile methodologies ETL, ELT skills, Data movement skills, Data...

  • Hevo Data

    2 weeks ago


    Bangalore/Bangalore, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Data Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Recro Full time

    Must-Have Skills & Qualifications:Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.•5+ years of experience in data engineering or a related role.•Proficiency in Apache Airflow for workflow scheduling and management.•Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and...

  • Data Engineer

    2 months ago


    Bangalore Metropolitan Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Data Engineer

    2 days ago


    Bangalore Metropolitan Area, India Alp Consulting Ltd. Full time

    Hands on Experience in Azure Data engineer with Azure data pipelines.Hands on Experience in Python, SQL, Power BI, Analytics

  • Senior Data Architect

    3 weeks ago


    Bangalore Metropolitan Area, India Trianz Full time

    Responsibilities -Architectural Design: Architect secure, scalable, highly performant data engineering and management solutions, including data warehouses, data lake, ELT / ETL, and real-time data engineering/pipeline solutions.Support Principal Data Architect in defining and maintaining Practice reference data engineering and data management...


  • Bangalore Metropolitan Area, India Akaike Technologies Full time

    Role: Senior Data Scientist 1Location: Bengaluru (Hybrid)Experience: 4+ yearsAkaike Technologies, Greater Bengaluru AreaCompany Overview:Akaike Technologies is a dynamic and innovative AI-driven company that builds impactful solutions across various domains. Our mission is to empower businesses by harnessing the power of data and AI to drive growth,...

  • Senior Data Developer

    4 weeks ago


    Bangalore Metropolitan Area, India Tata Consultancy Services Full time

    TCS is a global leader in IT services and consulting, serving clients across various industries.We are seeking a highly skilled Senior Data Developer to join our team. As a Senior Data Developer, you will play a key role in designing, developing, and implementing big data solutions to drive business growth and improve decision-making.The successful candidate...


  • Bangalore Metropolitan Area, India Prometheus Consulting Services. Full time

    Hi Folks,We are currently hiring for an International Retail Organization.Role: Senior Data Analyst-EcommerceExperience: 4+ YearsLocation-BangaloreEducation-Bachelor’s Degree in engineering, Business, marketing, finance or related field.Roles & Responsibilities:Core Responsibilities:The BA team comprises business intelligence and digital consulting...

  • Senior Data Engineer

    5 months ago


    Bangalore Metropolitan Area, India Tredence Inc. Full time

    Role & responsibilitiesWorking experience in Snowflake; use of Snow SQL CLI, Snow Pipe creation of custom functions and Snowflake stored producers, schema modelling, performance tuning etc.Expertise in Snowflake data modelling, ELT using Snowflake SQL, Snowflake Task Orchestration implementing complex stored Procedures and standard DWH and ETL...


  • Bangalore Metropolitan Area, India Aventra Group Full time

    C++ Technical Lead & Senior Software Engineer role at Aventra GroupJob DescriptionCompany DescriptionAventra Group is a boutique IT consultancy specializing in Enterprise Digital Solutions, Application Development, and Managed Services. With offices and delivery centers across Malaysia, Singapore, India, Vietnam, UAE, and the USA, Aventra Group combines...

  • Senior SRE Engineer

    2 months ago


    Bangalore Metropolitan Area, India ViewSonic Full time

    Senior SRE Engineer ViewSonic® inspires the world to see the difference between the ordinary and the extraordinary by providing excellence in visual solutions across software, hardware, and services. At ViewSonic Technologies, we’re passionate about building software that solves problems. We count on our site reliability engineers (SREs) to empower users...

  • Data QA Engineer

    2 months ago


    Bangalore Metropolitan Area, India Luxoft Full time

    LocationsBengaluru, Chennai, PuneProject descriptionWorking within the client's test and government framework, you will be responsible for creating the automation framework to support all data warehousing progression and regression testing and fix the defects.ResponsibilitiesAnalyse and document test data , results, and recommendations.Perform functional and...

  • Data Scientist

    4 weeks ago


    Bangalore Metropolitan Area, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Data ScientistRequired Skillset: 5+ Years, including the experience in designing and building of analytics use cases and productionization of the model for a quantified business value, for a minimum of 5 engagements Location: Bangalore/Pune/Chennai/Noida/Mumbai/HYD/IndoreExperience Range: 7-15 yearsJob DescriptionMust-Have**A...


  • Bangalore Metropolitan Area, India Stackave Solutions Full time

    We are hiring Senior Automation Test Engineer for Contract to hire position with our client.Senior Quality Assurance Automation EngineerExperience: 6 - 10 yearsLocation: BangaloreMode: Contract to HirePayroll: Stackave SolutionsImmediate Joiners PreferredSenior Quality Assurance Analyst (5+Yrs to 10 yrs of exp) is responsible for project-team testing...

  • Senior data engineer

    1 month ago


    Bangalore, India Rakuten Symphony Full time

    Job Title: Senior Data Engineer Location: Bangalore, India Company: Rakuten Symphony, India Overview Rakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...