Senior Data Engineer

3 weeks ago

Greater Bengaluru Area, India Applicantz Full time

THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.


Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is respected. Integrity, experience, honesty, people, humanity, and passion for excellence are some other adjectives that define this global technology leader.


Responsibilities:

  • Deploy and configure Apache Spark clusters on AWS (particularly EKS), optimizing for performance, resource allocation, and scalability.
  • Develop, automate, and support robust and reliable Spark data pipelines, focusing on high performance and low latency.
  • Design and implement highly optimized queries to improve data processing efficiency, streamline analysis, minimize latency, and enhance overall system performance.
  • Collaborate to make the Data Platform an effective, scalable, and resilient system.
  • Gather requirements from stakeholders, prioritize work, and document technical solutions clearly and effectively.
  • Engage with data engineers, data scientists, product managers, and internal stakeholders to align project goals and implementations.
  • Contribute to a team culture that values quality, robustness, and scalability while fostering initiatives and innovation​


Minimum Qualifications:

  • 5+ years of data processing experience in large cloud-based infrastructure (AWS is must)
  • Hands-on software development experience in Python, with strong proficiency in Py Spark for data engineering tasks and data pipeline development
  • Expert understanding of SQL, dimensional modeling, and analytical data warehouses, such as Snowflake
  • Understanding of Data Engineering best practices for medium to large scale production workloads
  • Expertise with data pipeline orchestration tools, such as Airflow
  • Familiar with processing semi-structured file formats such as json or parquet
  • Team player with good communication skills
  • Problem solver with excellent written and interpersonal skills
  • Strong problem-solving skills
  • Ability to learn new technical skills
  • Bachelor’s degree in Computer Science, Data Science, or related fields


Preferred Qualifications:

  • Experience with Jinja, Shell scripting, DBT
  • Developing in Cloud platform using serverless technologies such as glue, lambda, EMR is a plus.
  • Experience with remote development using AWS SDK is a plus
  • Experience with ELT pipelines - DBT
  • REST API design and implementation
  • Familiarity with containers and infrastructure-as-code principles
  • Experience with automation frameworks - Git, Jenkins, and Terraform

  • Senior Data Engineer

    4 weeks ago

    Greater Kolkata Area, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that...

  • Senior Data Engineer

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Data Engineer

    3 weeks ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...

  • Senior Cloud Engineer

    19 hours ago

    Greater Bengaluru Area, India Tata Consultancy Services Full time

    Job Title:Senior Cloud Engineer - Data Warehousing and AnalyticsCompany Overview:Tata Consultancy Services is a leading global technology consulting and business solutions organization. We are seeking a Senior Cloud Engineer to join our team.Salary:The estimated annual salary for this position is $120,000-$180,000, depending on experience and...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Senior Data Analyst

    1 week ago

    Greater Bengaluru Area, India Initus HR Consulting Pvt.Ltd-USA company Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer ,Data Analyst Experience: 7-12 Years Location: Bangalore Employment Type: Full-Time Summary: We are looking for a highly skilled Senior Data Engineer with 7-12 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services...

  • Senior Data Analyst

    1 week ago

    Greater Bengaluru Area, India Initus HR Consulting Pvt.Ltd-USA company Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer ,Data Analyst Experience: 7-12 YearsLocation: BangaloreEmployment Type: Full-TimeSummary:We are looking for a highly skilled Senior Data Engineer with 7-12 years of experience in SQL, Azure Data Factory (ADF), SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), and...

  • Senior Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job PurposeThe senior data...

  • Senior Data Engineer

    1 week ago

    Greater Bengaluru Area, India Tata Consultancy Services Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Tata Consultancy Services.With 5-9 years of experience, you will be responsible for developing and maintaining innovative Azure solutions using Databricks notebooks with Pyspark.Your key responsibilities will include:Ensuring data is cleansed, mapped, transformed, and optimized for...

  • Data Engineering Senior Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Data Engineering Leader

    1 month ago

    Greater Bengaluru Area, India CodeVyasa Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at CodeVyasa.The ideal candidate will have a strong background in designing, implementing, and maintaining large-scale data processing pipelines using PySpark for both streaming and batch processing.Key Responsibilities:Data Pipeline Development: Design, implement, and...

  • Senior Data Engineering Manager

    19 hours ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...

  • Senior Data Indexing Engineer for Enterprise RAG Systems

    3 weeks ago

    Greater Bengaluru Area, India Bryckel AI Full time

    We are seeking a highly skilled Senior Data Indexing Engineer to lead the development and optimization of our AI-powered data retrieval and knowledge management systems at Bryckel AI.About Us:Bryckel AI is a pioneering company that specializes in cutting-edge AI solutions. Our mission is to harness the power of artificial intelligence to revolutionize the...

  • Data Systems Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Data Engineer

    4 days ago

    Greater Hyderabad Area, India Insight Global Full time

    JOB DESCRIPTIONOur Tech clients within the Data & Analytics (DNA) Organization is seeking two experienced Senior Data Engineers to join our team in India. These individuals will play a crucial role in building analytical data assets and leveraging the modern data stack to support a new program, the modernization of internal data estate and analytics. The...

  • Senior Data Analytics Expert

    3 weeks ago

    Greater Bengaluru Area, India Calsoft Full time

    About Calsoft: We are a leading provider of technology solutions to top companies in the world. Our team is passionate about leveraging data science and engineering methodologies to drive business growth.Salary Range: ₹ 15,00,000 - ₹ 25,00,000 per annum (depending on experience)Job Description:We are seeking an experienced Senior Data Analytics Expert to...