![Techno Wise](https://media.trabajo.org/img/noimg.jpg)
PySpark Developers
4 weeks ago
PySpark
developer (
with ETL background
) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems.
Roles and Responsibilities
Ability to design, build and unit test the application in Spark/PysparkIn-depth knowledge of Hadoop, Spark, and similar frameworksAbility to understand existing ETL logic to convert into Spark/PySparkGood implementation experience of oops conceptsKnowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codecExperience in processing large amounts of structured and unstructured data, including integrating data from multiple sourcesExperience in working with Bitbucket and CI-CD processHave knowledge of the agile methodology for delivering the projectsGood communication skills
Skills
Minimum 2 years of extensive experience in design, build and deployment of PySpark-based applicationsExpertise in handling complex large-scale Big Data environmentsMinimum 2 years of experience in the following: HIVE, YARN, HDFSExperience in working in ETL products e.g. Ab Initio, Informatica, Data Stage etc.Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities
Experience: 6
to 10 Years
(EARLY JOINERS ONLY)
Location: Pune OR Chennai OR Hyderabad
Note: We can even consider someone with good hands-on experience in Spark and Scala.
-
PySpark Developers
4 weeks ago
chennai, India Techno Wise Full timeWe are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems. Roles and...
-
PySpark Developers
3 weeks ago
chennai, India Techno Wise Full timeWe are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems. Roles and...
-
Python Pyspark Developer
2 months ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
3 weeks ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
2 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
3 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
5 days ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Pyspark Dev
5 days ago
Chennai, Tamil Nadu, India Virtusa Full timePyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...
-
Python Pyspark Developer
2 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...
-
PySpark Architect
4 weeks ago
Chennai, India RapidBraiins Full timeJob Description- As a PySpark Architect, you will be responsible for architecting, designing, and implementing large-scale data processing systems using PySpark.- You will work closely with cross-functional teams to develop robust, scalable, and efficient data solutions.- Your deep experience in big data technologies and hands-on expertise in PySpark will be...
-
PySpark Architect
3 weeks ago
Chennai, India RapidBraiins Full timeJob Description- As a PySpark Architect, you will be responsible for architecting, designing, and implementing large-scale data processing systems using PySpark.- You will work closely with cross-functional teams to develop robust, scalable, and efficient data solutions.- Your deep experience in big data technologies and hands-on expertise in PySpark will be...
-
Apache Pyspark
1 month ago
Chennai, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManeva!JobDescriptionJobTitle ApachePyspark LocationChennaiExperience4 10YearsNotice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...
-
Pyspark Dev
5 days ago
Chennai, Tamil Nadu, India Virtusa Full timePyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...
-
Pyspark Developer
2 months ago
chennai, India Corporate Resources Full timeJob Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...
-
Apache Pyspark
5 days ago
Chennai, Tamil Nadu, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManevaJobDescriptionJobTitleApachePysparkLocationChennaiExperience4 10YearsNotice15 30DaysJobRequirements:Mandatory:Primary skill:PysparkEducation: B.Tech/M.Tech/MCA46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...
-
Hadoop Developer/PySpark Developer
4 weeks ago
Chennai, India Citi Full timeData Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...
-
Pyspark Dev
1 month ago
chennai, India Virtusa Full timePyspark Dev & QA - CREQ188700 Description Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...
-
Pyspark Dev
1 month ago
Chennai, India Virtusa Full timePyspark Dev & QA - CREQ188700 Description Pyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data ...
-
Tableau Developer
2 months ago
Bangalore,Chennai, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...
-
Hadoop Developer/PySpark Developer
4 weeks ago
Chennai, India 12542 Citicorp Services India Private Limited Full timeData Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...