![Techno Wise](https://media.trabajo.org/img/noimg.jpg)
PySpark Developers
4 weeks ago
We are looking for a PySpark developer ( with ETL background ) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems.
Roles and Responsibilities
Ability to design, build and unit test the application in Spark/Pyspark In-depth knowledge of Hadoop, Spark, and similar frameworks Ability to understand existing ETL logic to convert into Spark/PySpark Good implementation experience of oops concepts Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources Experience in working with Bitbucket and CI-CD process Have knowledge of the agile methodology for delivering the projects Good communication skills
Skills
Minimum 2 years of extensive experience in design, build and deployment of PySpark-based applications Expertise in handling complex large-scale Big Data environments Minimum 2 years of experience in the following: HIVE, YARN, HDFS Experience in working in ETL products e.g. Ab Initio, Informatica, Data Stage etc. Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities
Experience: 6 to 10 Years (EARLY JOINERS ONLY)
Location: Pune OR Chennai OR Hyderabad
Note: We can even consider someone with good hands-on experience in Spark and Scala.
-
Python Pyspark Developer
2 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
5 days ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
3 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Python Pyspark Developer
2 months ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
Python Pyspark Developer
3 weeks ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable data processing applications using Python and PySpark. Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various...
-
PySpark Developers
4 weeks ago
Chennai, India Techno Wise Full timeWe are looking for aPySparkdeveloper (with ETL background) to be able to design and build solution on one of our customer programs. This to build a data standardized and curation layer that will integrate data across internal and external sources, provide analytical insights and integrate with customer’s critical systems.Roles and ResponsibilitiesAbility...
-
Pyspark Dev
5 days ago
Chennai, Tamil Nadu, India Virtusa Full timePyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...
-
Python Pyspark Developer
2 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign, develop, and deploy scalable data processing applications using Python and PySpark.Collaborate with data scientists and analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data...
-
Apache Pyspark
1 month ago
Chennai, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManeva!JobDescriptionJobTitle ApachePyspark LocationChennaiExperience4 10YearsNotice15 30Days JobRequirements: Mandatory:Primary skill:Pyspark Education: B.Tech/M.Tech/MCA 46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...
-
PySpark Architect
3 weeks ago
Chennai, India RapidBraiins Full timeJob Description- As a PySpark Architect, you will be responsible for architecting, designing, and implementing large-scale data processing systems using PySpark.- You will work closely with cross-functional teams to develop robust, scalable, and efficient data solutions.- Your deep experience in big data technologies and hands-on expertise in PySpark will be...
-
PySpark Architect
4 weeks ago
Chennai, India RapidBraiins Full timeJob Description- As a PySpark Architect, you will be responsible for architecting, designing, and implementing large-scale data processing systems using PySpark.- You will work closely with cross-functional teams to develop robust, scalable, and efficient data solutions.- Your deep experience in big data technologies and hands-on expertise in PySpark will be...
-
Pyspark Dev
5 days ago
Chennai, Tamil Nadu, India Virtusa Full timePyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of installing, configuring, debugging and...
-
Apache Pyspark
5 days ago
Chennai, Tamil Nadu, India Maneva Consulting Pvt. Ltd Full timeGreetingsFromManevaJobDescriptionJobTitleApachePysparkLocationChennaiExperience4 10YearsNotice15 30DaysJobRequirements:Mandatory:Primary skill:PysparkEducation: B.Tech/M.Tech/MCA46 years ofexperience in the design and implementation of Big Data systemsusing PySpark database migration transformation and integrationsolutions for any Data...
-
Pyspark Developer
2 months ago
chennai, India Corporate Resources Full timeJob Description 1. Knowledge of the key phases of software delivery lifecycle and established software development methodologies 2. Must have strong understanding of data architecture, data integration and data management processes, ability to develop transformation logic in Spark-SQL based on...
-
Hadoop Developer/PySpark Developer
4 weeks ago
Chennai, India Citi Full timeData Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...
-
Pyspark Dev
1 month ago
chennai, India Virtusa Full timePyspark Dev & QA - CREQ188700 Description Pyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...
-
Pyspark Dev
1 month ago
Chennai, India Virtusa Full timePyspark Dev & QA - CREQ188700 Description Pyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data ...
-
Tableau Developer
2 months ago
Bangalore,Chennai, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...
-
Hadoop Developer/PySpark Developer
4 weeks ago
Chennai, India 12542 Citicorp Services India Private Limited Full timeData Engineer:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of big...
-
Pyspark Dev
1 month ago
Chennai, India Virtusa Full timePyspark Dev & QA - CREQ188700 DescriptionPyspark Dev & QAMandatory SkillsBIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySparkBuild CI/CD pipelines is required Outstanding coding, debugging and analytical skillsSpark APIs to cleanse, explore, aggregate, transform, store & analyse available dataKnowledge of...