![Maneva Consulting Pvt. Ltd](https://media.trabajo.org/img/noimg.jpg)
Apache Pyspark
3 days ago
GreetingsFromManeva
JobDescription
JobTitle ApachePyspark
LocationChennai
Experience4 10Years
Notice15 30Days
JobRequirements:
Mandatory:Primary skill:Pyspark
Education: B.Tech/M.Tech/MCA
46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data warehousingproject.
Must haveexcellent knowledge in Apache Spark and Python programmingexperience
Deep experiencein developing data processing tasks using PySpark such as readingdata from external sources merging data performing data enrichmentand loading into target datadestinations.
Experience indeployment and operationalizing the code knowledge of schedulingtools
Workingexperience on Cloud technology architecture like AWS ecosystemGoogle Cloud BigQuery etc. is an addedadvantage
Understanding ofUnix/Linux ShellScripting
Good knowledgeof Hadoop Hive and Cloudera/ Hortonworks DataPlatform
Experiencehandling CDC operations for huge volumes ofdata
Shouldunderstand and have operating experience with Agile deliverymethodologies
Should havehandson experience in the following: data validation writing unittestcases
Should haveexperience in integrating PySpark with downstream and upstreamapplications through a batch/realtimeinterface
Should haveexperience in finetuning process and troubleshooting performanceissues
If you are excited tograb this opportunity please apply directly or share your CV at and
Pyspark
-
Apache Pyspark
2 weeks ago
Chennai, Tamil Nadu, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManevaJobDescriptionJobTitleApachePysparkLocationChennaiExperience4 10YearsNotice15 30DaysJobRequirements:Mandatory:Primary skill:PysparkEducation: B.Tech/M.Tech/MCA46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...
-
Hiring For Apache Spark with Pyspark
5 days ago
Chennai, India timesjobs Full time**** **Hiring For Apache Spark with Pyspark****** Apache Spark with Pyspark**Desired Profile****Skills :** Pyspark, Big Data, Apache Spark and Python programming, Cloud technology architecture like AWS**Experience:** 4-6 years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration...
-
Apache Pyspark
3 days ago
chennai, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManeva! JobDescription JobTitle ApachePyspark LocationChennai Experience4 10Years Notice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions...
-
Hiring For Apache Spark with Pyspark
4 days ago
Chennai, Tamil Nadu, India timesjobs Full timeHiring For Apache Spark with Pyspark Apache Spark with PysparkDesired ProfileSkills : Pyspark, Big Data, Apache Spark and Python programming, Cloud technology architecture like AWSExperience: 4-6 years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data...
-
Python Pyspark Developer
3 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
2 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
4 weeks ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
4 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
3 hours ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...
-
Data Streaming
3 weeks ago
Chennai, India ACE Talent Consulting Full timeJob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
Data Streaming
3 weeks ago
Chennai, India ACE Talent Consulting Full timeob Description: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. **Responsibilities**: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce...
-
PySpark Application Developer
2 months ago
Chennai, India Corporate Resources Full timeJob DescriptionWork on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream and process datasets at low latencies Show efficiency in...
-
PySpark Application Developer
2 weeks ago
Chennai, Tamil Nadu, India Corporate Resources Full timeJob Description Work on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream and process datasets at low latencies Show efficiency...
-
PySpark Application Developer
3 months ago
chennai, India Corporate Resources Full timeJob Description Work on client projects to deliver AWS, PySpark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream...
-
Big Data Engineer
4 weeks ago
Chennai, India Sysvine Technologies Full timeExperience: 5 - 8 yearsKey Skills: Hadoop, Pyspark, Python, SQL, HiveLocation: ChennaiNotice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice periodWhat are we looking for?We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems, Hive,...
-
Senior Data Engineer
2 months ago
Chennai, India Cyber Sphere LLC Full timeSenior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...
-
Hadoop Developer/PySpark Developer
1 month ago
Chennai, India Citi Full timeData Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...
-
Big Data Engineer
4 weeks ago
Chennai, India Sysvine Technologies Full timeExperience: 5 - 8 years Key Skills: Hadoop, Pyspark, Python, SQL, Hive Location: Chennai Notice Period: We prefer candidates who can join immediately or candidates who are on break or candidates who are at end of their notice period What are we looking for? We are looking for experienced Big Data Hadoop Developer expertise with Hadoop, Big Data Ecosystems,...
-
Senior Data Engineer
4 weeks ago
Mumbai/Chennai, IN Cyber Sphere LLC Full timeSenior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...
-
Senior Data Engineer
2 months ago
Mumbai/Chennai, IN Cyber Sphere LLC Full timeSenior Data EngineerOnsite : Mumbai/ChennaiAbout the Role :- This role is more focused on Pyspark with Cloud developer.About the Responsibilities :- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled...