Big Data Developer

1 month ago


Pune, India CloudQ IT Services Full time

Looking for a candidate to help with migration of on-premise capital markets data lake to data bricks.

Key skills : Spark, Scala, Pyspark

- Good to have experience in Databricks

- 4+ experience with various Hadoop/Databricks ecosystem components, 3+ years hands-on experience in Spark (Scala).

- Working experience with Spark based data processing in Scala

- Strong ETL development with Scala ingesting data to Hadoop

- Experience in configuring and using Airflow

- Experience with Pyspark/Databricks is a plus

- Experience with development tools and frameworks like Spring, Git, Jenkins, Maven and Nexus.

- Experience/understanding of rest

- Experience/understanding of dependency injection frameworks like springboot

(ref:hirist.tech)
  • Big Data

    1 month ago


    Pune, India Zensar Technologies Full time

    **BIG DATA ( ANALYTICS AND DATA SCIENCE ) - BIG DATA - SNOWFLAKE** **-** **(** **0095838** **)** **Description** Experience in developing ETL pipelines in and out of data warehouse using Snowflakes Snow SQL Knowledge on writing SQL queries against Snowflake. Experience in developing scripts Unix, Python etc. to do Extract, Load and Transform data Should...


  • Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: We’re looking for a Big Data Administrator to join our growing Big Data Administration team. You will be based both from our offices in Leeds and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Data Engineering and Data Science teams to...

  • Big Data Developer

    2 weeks ago


    Pune, India Citi Full time

    Preferred Experience:Min last 4 yrs bigdata experienceExperience working with Big Data eco-system including tools such as HDFS, Spark, Map Reduce, Sqoop, HBase, Hive, Impala, Oozie.Performance tuning, table partitioning and indexing, process threading, bucketing, UDF User Defined Function (UDAF) and UDAF User Defined Aggregate Function (UDAF)Hands-on...

  • Big Data

    4 weeks ago


    Pune, India Zensar Technologies Full time

    **BIG DATA ( ANALYTICS AND DATA SCIENCE ) - BIG DATA - SNOWFLAKE** **-** **(** **0094963** **)** **Description** Snowflake Job Description: - Snowflake SQL Writing SQL queries against Snowflake Developing scripts Unix, Python, etc. to do Extract, Load, and Transform data - Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, Python,...


  • Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Big Data Engineer

    6 days ago


    pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Senior Data Engineer

    2 weeks ago


    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    1 month ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Big Data Engineer

    6 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    6 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Big Data Engineer

    6 days ago


    Pune, India Qualys Full time

    We are seeking a talented Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security...

  • Data Admin

    4 weeks ago


    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: Tableau and Big Data admin **What You'll Bring**: Tableau and Big Data admin **Impact You'll Make**: Tableau and Big data admin TransUnion Job Title Sr Analyst, Applications Support


  • pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...

  • Big Data QA Manual

    4 weeks ago


    Pune, Maharashtra, India XoriantːIN Full time

    **Big Data QA Manual** **-** **(**2400000662**)** **Description** - Manual tester with BigData experience - Good programming/scripting experience in Spark/Scala - Good in Tableau Testing - Collaborate with cross-functional teams to understand project requirements and Big Data system specifications. - Develop detailed test plans, test cases, and test scripts...

  • Big Data Lead

    4 weeks ago


    Pune, India Hexaware Technologies Full time

    Description:Expert in Snowflake implementations (with 7 to 10 years in Cloud/Data industry)7+ years' experience in cloud data engineering experience5+ years strong experience in SQL, stored procedures, ELT in Snowflake Environment.2+ years of experience in Python development for Data engineering.Experience cloud/on-prem devops tools for orchestration,...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks. Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based...


  • Pune, India Qualys Full time

    Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.Working with a team of engineers and architects, you will...

  • Big Data Expert

    1 month ago


    Pune, India Manning Global Full time

    Our client, a leading global IT service provider, is recruiting ** Big Data Expert** *** to join their pro ject in ** Pune, Bangalore, Kolkata.** **Position Title**: **Big Data Expert** **Position Type**: - Permanent**Start Date**: - ASAP**Location**: - India**Contact**: - Divya Shetty | +49 (0) 89 23 88 98 87**Requirements**: - Should have 3-4...