CGI - Big Data Engineer - Scala/Spark
4 weeks ago
Job Description :
- Experience in application development experience in Scala, Spark, scala test/Junit libraries with maven.
- Experience on Hive, Spark using Cloudera data platform.
- Knowledge of performance optimization on Hadoop platform, Spark and Scala.
- Ability to write optimized SQL queries.
- Ability to learn & adapt.
- Ability to communicate in clear & concise way.
- Experience in writing Unit test cases & perform thorough unit testing.
- CI/CD concepts, experience in Data bricks
- Experience working on Unix platform
- REST API basics
-
Big Data Engineer
3 weeks ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Data Lead Engineer
4 weeks ago
Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full timeJob Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...
-
Big Data Developer
4 weeks ago
Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full timeJob Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...
-
MakeMyTrip - Lead Data Engineer - Scala/Spark
2 weeks ago
Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full timeRequirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...
-
Big Data Engineer
4 weeks ago
Hyderabad/Bangalore/Indore, IN Nucleusteq Full timeJob Description :Role Requirements :- Profound programming language experience in Java/Scala and Python.- Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.- Understanding on Modernisation, Informatica migration- Must have understanding on messaging services and their integrations.- Good to have experience in streaming...
-
Big Data Engineer
4 weeks ago
Bangalore/Chennai/Pune/Noida/Cochin/Kochi/Trivandrum/Thiruvananthapuram/Hyderabad, IN SPG Consulting Solutions Pvt.Ltd Full timeLocation : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at leveraging...
-
Spark Engineer
3 weeks ago
Bangalore/Onsite In Bangalore, IN Cyber Sphere LLC Full timeJob Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...
-
Senior Big Data Engineer
4 weeks ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
Data Engineer
2 weeks ago
Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full timeRole : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...
-
Full Stack Data Engineer
4 weeks ago
Pune/Hyderabad, IN Idyllic Services Pvt Ltd Full timeAbout the job :Job Description :Job Title : Fullstack Data EngineerExperience : 7+ Yrs,Location : Pune, Hyderabad.Full Stack Data Engineer role is expected to own and manage end to end activities within the team. Person would be entrusted to developed solutions/design ideas related to Data Engineering, service upkeep, developing new capabilities and identify...
-
Data Engineer
4 weeks ago
Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full timeResponsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...
-
Senior Data Engineer
3 weeks ago
Bangalore/Kolkata/Pune, IN Nilasu consulting Full timeSummary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...
-
Data Engineer
4 weeks ago
Bangalore/Pune, IN Pylon Management Consulting Full timeRequirements:- Overall 5+ years of IT experience with 3+ years in data-related technologies.- Minimum 2.5 years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP).- Hands-on experience with the Hadoop stack - HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink,...
-
Senior Data Engineer- Spark/Python
4 weeks ago
Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full timeWe are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...
-
Tiger Analytics
3 weeks ago
Chennai/Bangalore/Hyderabad, IN Tiger Analytics Full timeJob Description :- Strong hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake- Strong programming skills in Python/Scala, Pyspark, SQL- Expertise in implementing design for data ingestion, data transformation, handling data source using batch processing, deriving metrics, applying data...
-
Bangalore/Chennai/Pune/Hyderabad, IN CGI Information Systems and Management Consultants Full timeJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Integrating new data management tools into company ecosystems- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for...
-
Azure Data Engineer
2 weeks ago
Bangalore/Hyderabad/Pune, IN Kezan Consulting Full timeWork Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...
-
Big Data Developer
4 weeks ago
Gurgaon/Gurugram/Bangalore, IN Workassist.in Full timeOur hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...
-
AWS Data Architect
4 weeks ago
Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full timeRole Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...
-
Big Data Engineer
4 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full timeKey Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...