(Apply in 3 Minutes) Spark Developer
22 hours ago
ETL Developer will be responsible for designing implementing and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System HDFS using Apache Spark and Python This role required deep understanding of data engineering principles proficiency in Python and hands-on experience with Spark and Hadoop ecosystems Developer will collaborate with data engineers analysts and business stakeholders to process transform and drive insights and data driven decisions Responsibilities Data Processing and Transformation Design and Implement of Spark applications to process and transform large datasets in HDFS Develop ETL Pipelines in Spark using Python for data Ingestion cleaning aggregation and transformations Performance Optimization Optimize Spark jobs for efficiency reducing run time and resource usage Finetune memory management caching and partitioning strategies for Optimal performance Data Engineering with Hadoop and Spark Load data from different sources into HDFS ensuring data accuracy and integrity Integrate Spark Applications with Hadoop frameworks like Hive Sqoop etc Testing and debugging Troubleshoot and debug Spark Job failures monitor job logs and Spark UI to Identify Issues Qualifications 2-5 years of relevant experience Experience in programming debugging used in business applications Working knowledge of industry practice and standards Comprehensive knowledge of specific business area for application development Working knowledge of program languages Consistently demonstrates clear and concise written and verbal communication Expertise in handling complex large-scale Warehouse environments Hands-on experience writing complex SQL queries exporting and importing large amounts of data using utilities Education Bachelor s degree in a quantitative field such as Engineering Computer Science or equivalent experience This job description provides a high-level review of the types of work performed Other job-related duties may be assigned as required Job Family Group Technology Job Family Applications Development Time Type Full time Most Relevant Skills Please see the requirements listed above Other Relevant Skills For complementary skills please see above and or contact the recruiter Citi is an equal opportunity employer and qualified candidates will receive consideration without regard to their race color religion sex sexual orientation gender identity national origin disability status as a protected veteran or any other characteristic protected by law If you are a person with a disability and need a reasonable accommodation to use our search tools and or apply for a career opportunity review View Citi s and the poster
-
▷ [Apply in 3 Minutes] Lead
2 weeks ago
Chennai, Tamil Nadu, India HCLTech Full timeDesignation LEAD No of Positions 1 Skill Primary SAP APPS -SAP HANA-D D-SAP ABAP on HANA Job Family Development Posting About HCLTech HCLTech is a global technology company spread across 60 countries delivering industry-leading capabilities centered around digital engineering cloud and AI powered by a broad portfolio of technology services and products We...
-
Spark
6 days ago
Chennai, Tamil Nadu, India Cognizant Full time**Job Summary** We are seeking a highly skilled Sr. Developer with 5 to 9 years of experience to join our dynamic team. Exposure on ETl flow management (Spark Nifi or any equivalent).Automated deployment scripts creation production pipeline creation **Responsibilities** - Develop and optimize data solutions using Data Activator ensuring high performance...
-
Apply in 3 Minutes: Data Analyst
4 weeks ago
Chennai, India People Prime Worldwide Full timeAbout the Company Our client, is a global IT services leader delivering digital transformation, cloud solutions, and data modernization strategies. With a footprint in 50+ countries, they empower businesses to evolve with cutting-edge technologies and industry-specific solutions. Job Description We are hiring an experienced Data Analyst with strong exposure...
-
Data Engineer
1 week ago
Chennai, India KaarTech Full timeKey Responsibilities· Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.· Data Integration: Integrate data from multiple sources and ensure data quality and consistency.· Data Modelling: Build and optimize data models using Spark to support complex data transformations...
-
BigData- Spark/Scala
3 weeks ago
Chennai, India Jobted IN C2 Full timeOverview: We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data...
-
(Apply in 3 Minutes) Senior Software Engineer
3 weeks ago
Chennai, Tamil Nadu, India Jobted IN C2 Full timeSitecore Developer - Digital Our business our culture One of the top 20 global general insurers and is recognised as Australia s largest international insurance and Reinsurance Company with operations in 37 countries around the world Seeking an experienced Digital Front-end lead to join our team This is a newly created role specialising with the Sitecore...
-
spark developer
5 days ago
chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
4 days ago
chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
5 days ago
Chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
-
spark developer
1 day ago
Chennai, India Tata Consultancy Services Full timeTCS HIRING!!! ROLE: Spark Developer JOB LOCATION : Chennai, Kolkata, Hyderabad , Ahmedabad,, Gurgaon EXPERIENCE : 6-8 years Required Technical Skill : Spark , Scala, Pyspark, python Job Description: Strong Knowledge on Spark, Scala, Python, PySpark · Strong in SQL concepts · Good to have Knowledge on Bigdata Technologies like Hive ,Sqoop,Pig,Kafka,Flume....
