Big data developer

4 days ago


Pune, India Recro Full time
To be successful in this role, you should possess
• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.
• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.
• Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Akka and Spark.
• Understanding and critically reviewing existing data pipelines, and coming up with ideas in collaboration with Technical Leaders and Architects to improve upon current bottlenecks
• Take initiatives, and show the drive to pick up new stuff proactively, and work as a Senior Individual contributor on the multiple products and features we have.
• 3+ years of experience in developing highly scalable Big Data pipelines.
• In-depth understanding of the Big Data ecosystem including processing frameworks like Spark, Akka, Storm, and Hadoop, and the file types they deal with.
• Experience with ETL and Data pipeline tools like Apache Ni Fi, Airflow etc.
• Excellent coding skills in Java or Scala, including the understanding to apply appropriate Design Patterns when required.
• Experience with Git and build tools like Gradle/Maven/SBT.
• Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
• Have elegant, readable, maintainable and extensible code style.
You are someone who would easily be able to
• Work closely with the US and India engineering teams to help build the Java/Scala based data pipelines
• Lead the India engineering team in technical excellence and ownership of critical modules; own the development of new modules and features
• Troubleshoot live production server issues.
• Handle client coordination and be able to work as a part of a team, be able to contribute independently and drive the team to exceptional contributions with minimal team supervision
• Follow Agile methodology, JIRA for work planning, issue management/tracking

  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...

  • Big Data Developer

    5 days ago


    Pune, India Recro Full time

    To be successful in this role, you should possess • Collaborate closely with Product Management and Engineering leadership to devise and build the right solution. • Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale. • Design and...

  • Big Data Developer

    5 days ago


    Pune, India Recro Full time

    To be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...

  • Big Data Developer

    4 days ago


    Pune, India Recro Full time

    To be successful in this role, you should possess• Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.• Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.• Design and...


  • Pune, Maharashtra, India Mig Staffing Full time

    We are seeking a highly skilled Senior Big Data Developer to design and implement robust Big Data solutions using Hadoop technologies. As a key member of our team, you will be responsible for developing and managing large-scale data processing systems, collaborating with cross-functional teams, and ensuring data quality and integrity.Key...


  • Pune, Maharashtra, India Mig Staffing Full time

    Job Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...

  • Big Data Developer

    6 months ago


    Pune, India F337 Deutsche India Private Limited, Pune Branch Full time

    Description Deutsche Bank is actively renewing its digital channels and has started many strategic and challenging projects. Next to some major technological changes Deutsche Bank has decided to step into the Agile software development methodology in order to improve its agility and reduce time to market without scarifying quality As a senior...

  • Big data

    1 month ago


    Pune, India NR Consulting - India Full time

    Job Title: Big DataExperience: 4-9 yearsLocation: PuneSkills: ETL Testing, SQL query, Java, Selenium, API Testing, Big Data(Junit/Test NG/Selenium)

  • Big Data Developer

    1 month ago


    Pune, India Tata Consultancy Services Full time

    Role- Big DataLocation- Mumbai, Pune, ChennaiExperience- 5 to 10 YrsMust Have - Spark, Pyspark, Hive, HbaseResponsibility of / Expectations from the Role1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills.2 Do impact analysis and come up with estimates3 Take responsibility for...

  • Big data developer

    2 months ago


    Pune, India Tata Consultancy Services Full time

    1 Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL 2 Experience working on Data Engineering projects 3 Good Understanding of SQL 4 Good understanding of Unix and HDFS commands 5 Communication 6 Experience working on Data Analytics and Pyspark 7 Exposure to Tableau & SAS

  • Big Data

    6 months ago


    Pune, India Virtusa Full time

    **Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...

  • Big Data Specialist

    5 months ago


    Pune, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big Data Specialist

    2 months ago


    pune, India Cybage Software Full time

    About CybageCybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big Data Developer

    1 month ago


    Pune, India Tata Consultancy Services Full time

    1 Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL2 Experience working on Data Engineering projects3 Good Understanding of SQL4 Good understanding of Unix and HDFS commands5 Communication6 Experience working on Data Analytics and Pyspark7 Exposure to Tableau & SAS

  • Big Data Developer

    2 months ago


    Pune, India Tata Consultancy Services Full time

    1 Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL2 Experience working on Data Engineering projects3 Good Understanding of SQL4 Good understanding of Unix and HDFS commands5 Communication6 Experience working on Data Analytics and Pyspark7 Exposure to Tableau & SAS

  • Big Data Developer

    1 month ago


    pune, India Tata Consultancy Services Full time

    1 Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL2 Experience working on Data Engineering projects3 Good Understanding of SQL4 Good understanding of Unix and HDFS commands5 Communication6 Experience working on Data Analytics and Pyspark7 Exposure to Tableau & SAS

  • Big Data Developer

    2 months ago


    Pune, India Tata Consultancy Services Full time

    1 Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL 2 Experience working on Data Engineering projects 3 Good Understanding of SQL 4 Good understanding of Unix and HDFS commands 5 Communication 6 Experience working on Data Analytics and Pyspark 7 Exposure to Tableau & SAS

  • Big Data Specialist

    2 months ago


    Pune, India Cybage Software Full time

    About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...

  • Big data specialist

    2 months ago


    Pune, India Cybage Software Full time

    About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies...

  • Big Data Specialist

    1 month ago


    pune, India Cybage Software Full time

    About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the world’s largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are...