![Ziniosedge](https://media.trabajo.org/img/noimg.jpg)
Python, Pyspark
7 days ago
Python, Pyspark
5
Technology Lead (Data Engineer)
BE
- 8+ years of industry experience as Lead Developer
- Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred.
- Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling bigdata
- Familiarity with any data ingestion tools, Familiarity with working with different file formats. Delta-Lake is highly preferred.
- Advanced Proficiency in Python and SQL.
- Familiarity with Unix.
- Familiarity with one of orchestration tools such as Airflow, DBT and Delta live tables.
- Familiarity in cloud native tools - AWS is preferred
- Familiarity with CI/CD process from developer point of view.
- Familiarity with Change Data Capture systems is nice to have.
- Familiarity with Docker is nice to have
-
Python/pyspark
2 weeks ago
Bengaluru, India Cognizant Technology Solutions Full time**Python/Pyspark Engineer** **Job Location: Bangalore/Willing to relocate to Bangalore** **Exp: 4 to 12 years** **Introduction**: We work with customers who need to improve their capacity to respond on computerized world and empower adaptability, evacuate execution boundaries, empower advancement, and modernize center frameworks and rethink their business...
-
Python+Pyspark
3 weeks ago
Bengaluru, India Wissen Full timeWissen Technology is now hiringPython+PysparkWe are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and...
-
Python+Pyspark
1 week ago
Bengaluru, Karnataka, India Wissen Full timeWissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...
-
Python,pyspark with Aws
1 week ago
Bengaluru, India Natobotics Technologies Private Limited Full time**INFOSYS IS HIRING PYTHON,PYSPARK WITH AWS FOR BANGALORE & MUMBAI** Exp : 5+ Yrs Role : Python,Pyspark With AWS Location : Bangalore & Mumbai Payroll : Natobotics Client : Infosys Below is JD. Skill Set (any 1 as primary pls mention) 1. Python 2. PySpark 3. AWS 4. SQL 5. Snowflake, 6. DevOps JD details 1. Design and develop data integration...
-
Python+Pyspark
3 weeks ago
Bengaluru, India Wissen Full timeWissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...
-
Python Pyspark Lead
1 week ago
Bengaluru, Karnataka, India Virtusa Full timePython Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...
-
Pyspark, Python, SQL
1 week ago
Bengaluru, Karnataka, India Black & White Business Solutions Full time**Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...
-
Pyspark
1 week ago
Bengaluru, Karnataka, India Riverforest Connections Full timePosition Purpose For the projects which are implemented on Data SSC platform, we need senior developer for python- pyspark development to migrate project from spark/scala to python-pyspark._ResponsibilitiesDirect ResponsibilitiesDesign high quality deliverables adhering to business requirement with defined standards and design principles, patternsDevelop and...
-
Data Engineer
6 hours ago
Bengaluru, India RiskInsight Consulting Pvt Ltd Full timeWe are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team. In this role, you will design, develop, and optimize data pipelines and workflows to support our data infrastructure and analytics needs. Your contributions will be crucial in ensuring the reliability, scalability, and performance of our data...
-
ML Engineer
2 months ago
Bengaluru, India Petals Careers Full timeRequirements :- Knowledge of AB testing : The candidate should have a solid understanding of AB testing methodologies, which are commonly used in data-driven decision-making processes to evaluate the effectiveness of different strategies or interventions.- Causal Inference: Proficiency in causal inference is crucial for understanding cause-and-effect...
-
Hiring For Data Bricks with Python/Pyspark
2 months ago
Bengaluru, Karnataka, India krazy mantra hr solutions Full timeApply for Hiring For Data Bricks With Python/Pyspark, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on
-
Bigdata + Pyspark
1 week ago
Bengaluru, Karnataka, India Impetus Technologies Full timeBIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...
-
Bigdata + Pyspark
1 week ago
Bengaluru, Karnataka, India Impetus Technologies Full timeBIgdata + Pyspark : Big Data; Hadoop / HDFS,Pyspark,Python Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...
-
Data Engineer
2 months ago
Bengaluru, India IBU Consulting Full timeJob Description :Duties and Responsibilities :- Maintain knowledge of evolving industry trends, practices, techniques, and standards on Big Data with a focus on AWS cloud technologies and Python/Pyspark from an application development perspective.- Be aware of DevOps practices and follow appropriate steps/tools to effect code migration during development...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Manvision Technologies Full timeSNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...
-
Data Developer
6 days ago
Bengaluru, India Airbus Full timeDescription:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...
-
Aws Pyspark
3 weeks ago
Bengaluru, India Cognizant Full timeMandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data Bricks Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc. Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark. Hands on experience with EMR Apache Spark...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Manvision Technologies Full timeSN Required Information Details 1 Role PySpark Developer 2 Required Technical Skill Set PySpark, Python, HDFS, Hadoop, SQL 3 No of Requirements 02 4 Desired Experience Range 5+ years Location of Requirement India Desired Competencies (Technical/Behavioral Competency) Must-Have Sound...
-
Aws Pyspark
1 week ago
Bengaluru, Karnataka, India Cognizant Full timeMandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data BricksExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark...
-
Python Pyspark Aws SQL
4 days ago
Bengaluru, Karnataka, India Virtusa Full timeRole: Data Engineer1) Minimum of 5+ years of experience in Data Engineering. Required technical skills: Python, PySpark, SQL, AWS2) Required Domain: Healthcare3) Extensive data analysis skills and Good communication skills Writing scalable code using Python programming language. Developing back-end components. Integrating user-facing elements using...