Senior Big Data Engineer

3 weeks ago

Bengaluru, India DATASPARK HIRE Full time

We are seeking a talented BigData Engineer with 2 to 5 years of experience tojoin our data engineering team. The successful candidate will playa crucial role in designing building and maintaining our big datainfrastructure and pipelines. You will work with large datasetsensuring data accessibility reliability and efficiency to supportdatadriven decisionmaking processes across theorganization.

KeyResponsibilities:

  • Data PipelineDevelopment:

    • Designdevelop and maintain scalable datapipelines to process large volumes of dataefficiently.
    • Implement robustETL (Extract Transform Load) processesto ensure data integrity and quality.

  • Data Storage andManagement:

    • Manageand optimize big data storagesolutions (e.g. HDFS NoSQL databases) forperformance and scalability.
    • Develop andmaintain data warehouses anddata lakes to support analytical andreporting needs.

  • Data Processing:

    • Utilize big data processing frameworks such asApache SparkHadoop andKafka to perform complex datatransformations and analytics.
    • Develop bothrealtime and batch data processing solutions to meet businessrequirements.

  • Data Integration:

    • Integrate data from various sources includingstructured and unstructured data to create unifieddatasets.
    • Collaborate with data scientists andanalysts to ensure seamless data integration for analyticalpurposes.

  • PerformanceOptimization:

    • Optimize data processing performance and efficiencythrough performance tuning and optimization techniques.
    • Implement best practices for data partitioning indexingand compression to enhance query performance.

  • DataQuality and Governance:

    • Establish and enforce data quality standards and datagovernance policies to ensure data accuracy andcompliance.
    • Implement data validation andmonitoring processes to identify and address data quality issuesproactively.

  • Collaboration andLeadership:

    • Workclosely with crossfunctional teams including data scientistsanalysts and software engineers to understand data requirements anddeliver effective data solutions.
    • Providetechnical leadership and mentorship to junior team membersfostering their professional growth and development.

  • ContinuousImprovement:

    • Stayabreast of emerging technologies and industry trends in big dataand data engineering.
    • Drive continuousimprovement initiatives to enhance the efficiency scalability andreliability of our big data infrastructure andprocesses.
RequiredQualifications:

  • Education:

    • Bachelor’s degree in ComputerScience Information Technology or a related field.

  • TechnicalSkills:

    • Proficiencyin big data technologies such as Hadoop SparkKafka and related ecosystems.
    • Strong programming skills in languages likeJava Scala or Python for dataprocessing and scripting.
    • Experience withETL tools and processes for dataintegration and transformation.
    • Solidunderstanding of SQL andNoSQL databases for data storage andretrieval.
    • Familiarity withcloud platforms (e.g. AWS Azure GoogleCloud) and their big data services.

  • Experience:

    • 2 to 5 years of handson experience in big dataengineering roles with a proven track record of delivering complexdata solutions.
Soft Skills:
  • Strong problemsolving andanalytical abilities.
  • Excellent communication and collaborationskills.
  • Ability towork effectively in a fastpaced and dynamicenvironment.
  • Attention to detail and acommitment to delivering highquality solutions.

  • Big Data Engineer

    1 month ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    1 month ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 months ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Big Data Software Engineer

    1 week ago

    Bengaluru, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...

  • Senior Big Data Software Engineer

    2 days ago

    Bengaluru, Karnataka, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES· Strong experience ofoverall 9 to 12 yearsof experience as a data engineer, database developer, or...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data engineer,...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data engineer,...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 23, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES · Strong experience of overall 9 to 12 years of experience as a data engineer,...

  • Senior Software Engineer Big Data

    3 weeks ago

    Bengaluru, Karnataka, India eMids Technologies Pvt Ltd Full time

    Apply for Senior Software Engineer Big Data RR/431/2024, Career Progress Consultants in Bengaluru/ Bangalore for 4 - 6 Year of Experience on

  • Senior Software Engineer Big Data

    2 days ago

    Bengaluru, Karnataka, India eMids Technologies Pvt Ltd Full time

    Apply for Senior Software Engineer Big Data RR/431/2024, Career Progress Consultants in Bengaluru/ Bangalore for 4 - 6 Year of Experience on

  • Senior Software Engineer Big Data

    2 weeks ago

    Bengaluru, Karnataka, India eMids Technologies Pvt Ltd Full time

    Apply for Senior Software Engineer Big Data RR/431/2024, Career Progress Consultants in Bengaluru/ Bangalore for 4 - 6 Year of Experience on

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESStrong experience of 9 to 12 years as a data engineer, database developer, or similar role, focusing on data warehousing and analytics.Minimum 5 years of experience in...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES Strong experience ofoverall 9 to 12 yearsof experience as a data engineer, database developer, or...

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, India Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Senior GCP Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget :Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Senior Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India DATASPARK HIRE Full time

    We are seeking a talented BigData Engineer with 2 to 5 years of experience tojoin our data engineering team. The successful candidate will playa crucial role in designing building and maintaining our big datainfrastructure and pipelines. You will work with large datasetsensuring data accessibility reliability and efficiency to supportdatadriven...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India TCCS Full time

    Job Title: Senior Data EngineerCompany: Carelon Global SolutionsJob Description:Requirements: Minimum of 9 years of hands-on experience in Software development. At least 2 years of hands-on experience as a Technical Lead for project work. Design, deploy, and manage high-quality data solutions in AWS cloud ecosystem. Create and maintain optimal data...