CGI - Big Data Engineer - Scala/Spark

1 month ago


Pune, India CGI Information Systems and Management Consultants Full time

Job Description :


- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.

- Experience on Hive, Spark using Cloudera data platform.

- Knowledge of performance optimization on Hadoop platform, Spark and Scala.

- Ability to write optimized SQL queries.

- Ability to learn & adapt.

- Ability to communicate in clear & concise way.

- Experience in writing Unit test cases & perform thorough unit testing.

- CI/CD concepts, experience in Data bricks

- Experience working on Unix platform

- REST API basics

(ref:hirist.tech)

  • Pune,Bangalore,Chennai,Hyderabad, India CGI Information Systems and Management Consultants Full time

    Job Description : - Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear...


  • Pune/Bangalore/Chennai/Hyderabad, IN CGI Information Systems and Management Consultants Full time

    Job Description :- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.- Experience on Hive, Spark using Cloudera data platform.- Knowledge of performance optimization on Hadoop platform, Spark and Scala.- Ability to write optimized SQL queries.- Ability to learn & adapt.- Ability to communicate in clear &...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the profiles....

  • Data Engineer

    2 weeks ago


    Pune/Hyderabad, India SKYGATE CONSULTING Full time

    Role : Data EngineerExp : 5-12yrsLocation : Pune/HyderabadNotice Period : Immediate Joiners/ServingJob Description : Candidates who have good exposure in : - Strong Experience in Scala-Spark Development. - Strong experience in Apache, PySpark, Hadoop, Scala, Apache spark .- Extensive experience in writing advanced SQL statements and performance tuning...

  • WovV Technologies

    1 month ago


    Pune, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...

  • WovV Technologies

    1 month ago


    Pune, India Wovv Technology Full time

    Job Description: Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years. Contract Duration: Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery. Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the...

  • Big Data Developer

    4 weeks ago


    Pune, India SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Big Data Developer

    1 month ago


    Pune, India CloudQ IT Services Full time

    Looking for a candidate to help with migration of on-premise capital markets data lake to data bricks. Key skills : Spark, Scala, Pyspark- Good to have experience in Databricks - 4+ experience with various Hadoop/Databricks ecosystem components, 3+ years hands-on experience in Spark (Scala). - Working experience with Spark based data processing in Scala-...

  • Big Data Developer

    4 weeks ago


    Bangalore,Gurgaon,Gurugram,Pune,Chennai,Coimbatore,Mumbai,Cochin,Kochi,Noida, India SP Software Pvt. Ltd. Full time

    Job Description : - Should have hands on experience in Software development - Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering...

  • Big Data Developer

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Big Data Engineer

    1 month ago


    Pune, India SPG Consulting Solutions Pvt.Ltd Full time

    Location : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at leveraging...

  • WovV Technologies

    1 month ago


    Pune, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...

  • WovV Technologies

    1 month ago


    Pune, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...

  • WovV Technologies

    4 weeks ago


    Pune, Maharashtra, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...


  • Pune, India Radioactive Technologies Full time

    Spark & Scala DeveloperExp- 7-13 yrsShift- Malaysian / EURFull time Contract OpportunityFully Remoteplease share resume at Responsibilities-Create Scala/Spark jobs for data transformation and aggregationProduce unit tests for Spark transformations and helper methodsWrite Scaladoc-style documentation with all codeDesign data processing pipelinesSkills-Scala...

  • Big Data Engineer

    1 month ago


    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Big Data Engineer

    1 month ago


    Pune, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Big Data Engineer

    4 weeks ago


    Pune, Maharashtra, India Www.Huquo.com Full time

    Big Data Engineer( Lead assistant manager-Manager) Job Description : Must Have : Tech savvy engineer - willing and able to learn new skills, track industry trend.- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related...

  • Data Engineer

    1 month ago


    Pune, India TD NEWTON Full time

    Job Description : Must have Requirements : To be successful in this role, you should meet the following requirements : - Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+. - Experience with most of the following technologies : Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL...


  • Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full time

    Job Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...