Senior Data Engineer

4 hours ago

Bengaluru Karnataka India, Karnataka Cloudwick Full time

About the role


We are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to capture and store data on behalf of the business.


Key Responsibilities


  • Design, develop, and maintain ETL processes and data pipelines using AWS Glue with Pyspark.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
  • Optimize and tune data pipelines for performance and scalability.
  • Ensure data quality and integrity through robust testing and validation processes.
  • Implement data governance and security best practices.
  • Monitor and troubleshoot data pipelines to ensure continuous data flow and address any issues promptly.
  • Stay up-to-date with the latest trends and technologies in data engineering.


Required Qualification


  • B.E/B.Tech, preferably in Computer Science Engineering with relevant work experience.
  • 7+ years of experience in handling data and designing ETL pipelines with mandatory 4+ years experience in writing Spark.
  • Experience with AWS services such as Glue, Athena, S3, and Redshift is a plus.
  • Good to have exposure to data modeling, data analytics, and design in both batch processing and real-time streaming.
  • Solid understanding of data mapping, data processing patterns, distributed computing, and building applications for real-time and batch analytics
  • Strong programming skills in design and implementation using Python, PySpark, SQL
  • Good exposure in database architecture with SQL.
  • Experience with multiple file formats like Avro, Parquet, ORC, and JSON.
  • Developing, constructing, testing, and maintaining architectures for data lakes, data pipelines, data warehouses, and large-scale data processing systems on Databricks.

  • Senior Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Senior Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India, Karnataka Meril Full time

    We're Hiring: Senior Data EngineerWe are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data architectures, cloud platforms, and high-performance engineering, we want to meet you. Key Technical ResponsibilitiesDesign and build scalable ETL/ELT pipelines for...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 14,00,000 per year

    Req ID: 345817NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....

  • Senior Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India, Karnataka Nityo Infotech Full time

    Senior Data Engineer Position OverviewWe are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site. This role requires a self-starter who can architect and implement robust data foundation layers while providing technical leadership and guidance to the engineering team. The ideal candidate will have deep...

  • Senior Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India, Karnataka Zluri Full time

    Senior Data EngineerFunction : EngineeringJob Location : Whitefield, BangaloreReporting to : Engineering ManagerAbout UsZluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover identities and applications, streamline access management, and automate access reviews—all from a single, intuitive...

  • Senior Data Engineer cum Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Data Engineer Senior Consultant

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Senior Data Engineer

    4 hours ago

    Bengaluru, Karnataka, India, Karnataka PRI Global Full time

    Role: Senior Data EngineerLocation: Bangalore (Hybrid)Experience: 8+ years overall experienceKey Requirements:Minimum 5+ years of experience in SnowflakeMinimum 5+ years of experience in Python developmentDemonstrated ownership and accountability for end-to-end deliveryTechnical Skills (Mandatory):Python, Snowflake, SQLGit, Confluence, JiraJob Title:...

  • Senior Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...