Highly Scalable Big Data Engineer

2 days ago


Pune, Maharashtra, India Recro Full time
About the Role

We are seeking a highly skilled Big Data Engineer to join our team at Recro.

Job Description

In this role, you will be responsible for designing and implementing scalable data pipelines using distributed processing tools like Akka and Spark.

You will work closely with Product Management and Engineering leadership to devise and build the right solution for our clients.

Additionally, you will participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.

Your responsibilities will include designing systems to cleanse, process, and analyze large data sets.

You will also have the opportunity to take initiatives and show drive to pick up new stuff proactively, working as a Senior Individual contributor on multiple products and features we have.

Requirements
  • 3+ years of experience in developing highly scalable Big Data pipelines
  • In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop
  • Experience with ETL and Data pipeline tools like Apache NiFi, Airflow etc.
  • Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required
  • Experience with Git and build tools like Gradle/Maven/SBT
  • Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization
What We Offer

$120,000 - $180,000 per year salary based on your level of expertise

We offer a competitive benefits package, including health insurance, retirement plan, and paid time off

At Recro, we value teamwork and collaboration, so you'll have the opportunity to work closely with our US and India engineering teams

We follow Agile methodology, JIRA for work planning, issue management/tracking, and encourage continuous learning and professional growth



  • Pune, Maharashtra, India Virtusa Full time

    Job Title: Scalable Big Data EngineerAbout the RoleVirtusa is seeking an experienced Scala and Spark Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Scala and Spark.Key Responsibilities- Design and develop scalable big data...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India PubMatic Full time

    Company OverviewPubMatic is a leading digital advertising company that empowers the world's top content creators to control their inventory and increase monetization. With its sell-side platform, PubMatic delivers scalable and flexible programmatic innovation, improving outcomes for customers while championing a vibrant and transparent digital advertising...


  • Pune, Maharashtra, India Circana Full time

    At Circana, we are on a mission to empower our team members with the skills and knowledge they need to excel in their roles. As a Big Data Engineer Lead, you will be part of a dynamic team that is passionate about delivering high-quality solutions.We are seeking an experienced technical lead who can evaluate domain, financial, and technical feasibility of...

  • GCP Data Engineer

    4 days ago


    Pune, Maharashtra, India Tata Consultancy Services Full time

    We are looking for a highly skilled GCP Data Engineer - Big Data Expert to join our team at Tata Consultancy Services. As a GCP Data Engineer, you will play a critical role in designing and implementing scalable data processing systems on Google Cloud Platform.About the Role:We are seeking an experienced professional with a strong background in GCP-based big...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...


  • Pune, Maharashtra, India Synechron Full time

    We are seeking a highly skilled Ab Initio developer to join our team of experienced data engineers. As a key member of our data-intensive environment, you will lead the design and development of complex data processing applications using Ab Initio and Apache Spark.In this senior role, you will be responsible for creating high-volume data integration...


  • Pune, Maharashtra, India ProcDNA ytics Pvt Ltd Full time

    Key ResponsibilitiesDesign and Implement Scalable Data SolutionsDrive the development and maintenance of efficient data collection, storage, and processing systems for seamless integration and analysis.Lead a Team of Junior AssociatesCultivate and manage a team of junior professionals to enhance their skills and productivity, ensuring they are equipped to...

  • Big Data Engineer

    2 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer - Databricks Expert to join our team at LTIMindtree. The ideal candidate will have experience with Azure Databricks, Python, and Time Series Processing.About the RoleAs a Big Data Engineer - Databricks Expert, you will design, construct, install, test, and maintain highly scalable data management...


  • Pune, Maharashtra, India PubMatic Full time

    Job Title: Design and Implement Ad Server FeaturesWe are seeking an experienced software engineer to join our team at PubMatic. As a key member of our engineering team, you will be responsible for designing and implementing highly scalable and low latency ad server features.Responsibilities:Design and implement new features for our ad server...


  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Data Engineer Leader

    1 month ago


    Pune, Maharashtra, India DATAECONOMY Full time

    About the RoleDataEconomy is seeking a Senior Data Engineer to lead our team in designing and implementing big data solutions using PySpark.Key ResponsibilitiesLead the design and implementation of scalable and robust data pipelines using PySpark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Mentor and...

  • Data Engineer

    2 days ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...


  • Pune, Maharashtra, India PubMatic Full time

    PubMatic is an innovative technology company revolutionizing the digital advertising industry with its cutting-edge sell-side platform.The platform empowers leading digital content creators to control their inventory and maximize monetization by enabling marketers to drive return on investment and reach addressable audiences across ad formats and...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Senior Data Pipeline Engineer to join our team in Pune, Hyderabad, Bangalore, Chennai, Noida or Nagpur. The ideal candidate will have 5-10 years of experience in designing and building production data pipelines using Cloud Native GCP, Python, SQL and other relevant technologies.Key ResponsibilitiesDesign and...

  • Chief Data Architect

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data-driven solutions for over 50 years in the US.Our global centre of excellence in Pune delivers mission-critical data services to our clients using a proprietary cloud-based technology platform and leveraging proprietary business & consumer databases.We are headquartered in Dallas, TX, USA.The...


  • Pune, Maharashtra, India Techno Wise Full time

    Job Title: Azure Data Engineer\helpersCompany Overview:\helpersAt Techno Wise, we are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer.\helpersThe ideal candidate will have a strong background in Azure data technologies and a proven track record of ability to design and implement scalable and efficient data...

  • Big Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Talent Pro Full time

    Talent Pro is seeking a highly skilled Big Data Engineer - Distributed Architecture Specialist to join our team. As a key member of our data engineering group, you will play a crucial role in designing and implementing scalable distributed architectures using Apache Spark.The estimated salary for this position is $120,000 per year, based on industry...


  • Pune, Maharashtra, India ADCI PNQ 13 SEZ Full time

    About the RoleWe are seeking an experienced Big Data Architect to join our team at ADCI PNQ 13 SEZ, where you will be responsible for designing and implementing scalable data solutions that drive business growth and innovation.


  • Pune, Maharashtra, India Consulting Pandits Full time

    About Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...


  • Pune, Maharashtra, India Mig Staffing Full time

    About Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....