Recro | Senior Data Engineer

3 days ago


bangalore, India Recro Full time

Title: Senior Data Engineer

Skills: NoSQL, Pyspark, Distributed Systems, HDFS, Big Data


Responsibilities

  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.
  • Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.
  • Build data pipelines that optimize on data quality and are resilient to poor quality data sources.
  • Own the data mapping, business logic, transformations and data quality.
  • Low level systems debugging, performance measurement & optimization on large production clusters.
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures.


Required Skills

  • Proficiency in Python and pyspark.
  • Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames. Create Java/ Scala Spark jobs for data transformation and aggregation.
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
  • Good understanding of the architecture and functioning of Distributed database systems.
  • Experience working with various file formats like Parquet, Avro, etc for large volumes of data.
  • Experience with one or more NoSQL databases.
  • Experience with AWS, GCP.
  • 5+ years of professional experience as a data or software engineer.



  • bangalore, India Recro Full time

    WE ARE HIRING !!Designation - Senior Data EngineerLocation - Bangalore / Kochi. ( Hybrid)Experienced - 6+Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to used open stack technologies leveraging Python...


  • bangalore, India Recro Full time

    Title : Senior Data EngineerSkills: Python, Pyspark, Azure, SQL, GithubDomain : Pharmacy solutions, clinical care services.Data Engineering project which needs to source data from multiple sources(Batch sources primarily, streaming sources is something that is good to have) to transform load into Data Lake. The client wants to use open stack technologies...

  • Recro | Data Engineer

    2 weeks ago


    bangalore, India Recro Full time

    Must-Have Skills & Qualifications:Bachelorʼs degree in Computer Science, Engineering, or a related field; Masterʼs degree preferred.•5+ years of experience in data engineering or a related role.•Proficiency in Apache Airflow for workflow scheduling and management.•Strong experience with Hadoop ecosystems, including HDFS, MapReduce, and...


  • bangalore, India Recro Full time

    Education: Top Tie one collegeWe are growing rapidly and seeking a strong Data Engineer to be a key member ofthe Data and Business Intelligence organization with a focus on deep data engineeringprojects. You will be joining as one of the few initial data engineers as part of the dataplatform team in our Bengaluru office. You will have an opportunity to help...


  • bangalore, India Recro Full time

    Job Title: Head of Talent AcquisitionLocation: ReYears of Experience: 3-5 yearsAbout RecroRecro is a developer-focused platform that was founded to seamlessly match individual expertise with the right opportunities. We empower talented developers by providing them with relevant experience at fast-growing startups based on technical competencies and...


  • bangalore, India Recro Full time

    Title: Data Engineer Key skills: Python + SQL + GCP / AWS + Kubernate+ CI/CD Good to have background in Oil & Gas Data Engineering team is part of Global Customer Success (GCS) organization, which has a global presence in Oslo (Norway), Austin & Houston (Texas, USA), Tokyo (Japan), and now Bengaluru, India. GCS comprises Project Managers, Data Scientists,...


  • bangalore, India Recro Full time

    Title: Data EngineerKey skills: Python + SQL + GCP / AWS + Kubernate+ CI/CDGood to have background in Oil & GasData Engineering team is part of Global Customer Success (GCS) organization, which has a global presence in Oslo (Norway), Austin & Houston (Texas, USA), Tokyo (Japan), and now Bengaluru, India.GCS comprises Project Managers, Data Scientists, Data...


  • bangalore, India Recro Full time

    Title: Data EngineerKey skills: Python + SQL + GCP / AWS + Kubernate+ CI/CD Good to have background in Oil & GasData Engineering team is part of Global Customer Success (GCS) organization, which has a global presence in Oslo (Norway), Austin & Houston (Texas, USA), Tokyo (Japan), and now Bengaluru, India.GCS comprises Project Managers, Data Scientists, Data...


  • bangalore, India Recro Full time

    Role on Offer: Senior Integration EngineerThis position is based in Bangalore. As Senior Integration Engineer, you will be responsible for designing, implementing, and maintaining complex integration solutions across diverse platforms and applications. This role requires deep technical expertise in integration methodologies, data transformation, and API...


  • bangalore, India Recro Full time

    Role on Offer: Senior Integration Engineer This position is based in Bangalore. As Senior Integration Engineer, you will be responsible for designing, implementing, and maintaining complex integration solutions across diverse platforms and applications. This role requires deep technical expertise in integration methodologies, data transformation, and API...


  • bangalore, India Recro Full time

    We are hiring !!Position - Data ArchitectLocation - Bangalore( Hybrid )Experience - 10 +RequirementsWhat You'll Need:10+ years of experience in Analytics Engineering, Data Architecture, or similar roles.Strong SQL skills, proficiency in Python, and experience with diverse database management systems.Familiarity with modern data stack tooling and cloud data...


  • bangalore, India Recro Full time

    Job Title: Head of Talent Acquisition Location: Re Years of Experience: 3-5 years About Recro Recro is a developer-focused platform that was founded to seamlessly match individual expertise with the right opportunities. We empower talented developers by providing them with relevant experience at fast-growing startups based on technical competencies and...


  • bangalore, India Recro Full time

    Job Title: Head of Talent AcquisitionLocation: ReYears of Experience: 3-5 yearsAbout RecroRecro is a developer-focused platform that was founded to seamlessly match individual expertise with the right opportunities. We empower talented developers by providing them with relevant experience at fast-growing startups based on technical competencies and...


  • bangalore, India Recro Full time

    About the Role: We are looking for a highly skilled Frontend Developer to join Recro, cutting-edge team working on the development of an enterprise portal. This role involves building intuitive UIs, integrating with a robust backend platform, and contributing to the product's overall user experience. You’ll have the opportunity to work on Configuration...


  • bangalore, India Recro Full time

    About the Role: We are looking for a highly skilled Frontend Developer to join Recro, cutting-edge team working on the development of an enterprise portal. This role involves building intuitive UIs, integrating with a robust backend platform, and contributing to the product's overall user experience. You’ll have the opportunity to work on Configuration...


  • bangalore, India Recro Full time

    About the Role:We are looking for a highly skilled Frontend Developer to join Recro, cutting-edge team working on the development of an enterprise portal. This role involves building intuitive UIs, integrating with a robust backend platform, and contributing to the product's overall user experience. You’ll have the opportunity to work on Configuration...


  • bangalore, India Recro Full time

    We are hiring !! Position - Data Architect Location - Bangalore( Hybrid ) Experience - 10 + Requirements What You'll Need: 10+ years of experience in Analytics Engineering, Data Architecture, or similar roles. Strong SQL skills, proficiency in Python, and experience with diverse database management systems. Familiarity with modern data stack tooling and...


  • bangalore, India Recro Full time

    We are hiring !! Position - Data Architect Location - Bangalore( Hybrid ) Experience - 10 + RequirementsWhat You'll Need:10+ years of experience in Analytics Engineering, Data Architecture, or similar roles.Strong SQL skills, proficiency in Python, and experience with diverse database management systems.Familiarity with modern data stack tooling and cloud...


  • bangalore, India Recro Full time

    Location: Bengaluru, Karnataka Type: Full-Time Experience Level: 4-5 years of experience in machine learning and AI engineering. About the Role We are looking for a Senior Machine Learning Engineer who will design, develop, and deploy machine learning models to solve real-world problems. You will work on cutting-edge projects that use data to enhance user...


  • bangalore, India Recro Full time

    Location: Bengaluru, Karnataka Type: Full-Time Experience Level: 4-5 years of experience in machine learning and AI engineering. About the Role We are looking for a Senior Machine Learning Engineer who will design, develop, and deploy machine learning models to solve real-world problems. You will work on cutting-edge projects that use data to enhance user...