Python, pyspark data engineer
3 weeks ago
Technical Stack: Python, Spark, AWS, Py Spark Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and Git Lab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platform’s services. Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Qualifications · Experience building and optimizing data pipelines in a distributed environment . Data Modelling and Design Experience of atleast 5 years · Experience supporting and working with cross-functional teams · Proficiency working in Linux environment . 8+ years of advanced working knowledge of SQL, Python, and Py Spark · 8+ years of experience with using a broad range of AWS technologies Mandatory · Experience using tools such as: Git/Bitbucket, Jenkins/Code Build, Code Pipeline · Experience with platform monitoring and alerts tools
-
Data Engineer Python+Pyspark
2 months ago
Bangalore, India Mopid Full timeData Engineer (Python + PySpark) Position Experience Range: 2-6 years Job Timing: This is a full-time position Job Type: The role is designed as a hybrid work arrangement We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of...
-
Data Engineer
1 month ago
Bangalore/Hyderabad, India ANRI Solutions HR Services Full timeJob Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...
-
Senior Data Engineer
1 month ago
Bangalore, India SKYLARK HR SOLUTIONS Pvt Ltd Full timePosition : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...
-
Mopid | Data Engineer Python+Pyspark | bangalore
1 month ago
bangalore, India Mopid Full timeData Engineer (Python + PySpark) PositionExperience Range: 2-6 yearsJob Timing: This is a full-time positionJob Type: The role is designed as a hybrid work arrangementWe are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in the...
-
Python/PySpark Developer
1 week ago
Bangalore, India Resource Quick Full timeKey Responsibilities : - Develop robust and scalable Python and PySpark applications to support data engineering and analytics initiatives.- Design and deploy cloud-native solutions on AWS, leveraging services like EC2, Lambda, S3, RDS, Redshift, and Glue.- Manage and transform large datasets, ensuring efficient data ingestion and migration through...
-
Mopid | Data Engineer Python+Pyspark | bangalore
2 months ago
bangalore, India Mopid Full timeData Engineer (Python + PySpark) Position Experience Range: 2-6 years Job Timing: This is a full-time position Job Type: The role is designed as a hybrid work arrangement We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in...
-
Mopid | Data Engineer Python+Pyspark | bangalore
2 months ago
bangalore, India Mopid Full timeData Engineer (Python + PySpark) PositionExperience Range: 2-6 yearsJob Timing: This is a full-time positionJob Type: The role is designed as a hybrid work arrangementWe are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in the...
-
Senior Data Integration Engineer
2 days ago
Bangalore, India Coders Brain Technology Private Limited Full timeJob Description : We are seeking a highly skilled and experienced Senior Data Integration Engineer to join our dynamic team. The ideal candidate will have a strong background in AppFlow, PySpark, Python, AWS Lambda, API ingestions, TerraForm, and experience with Informatica Cloud or SnapLogic. This role requires a professional with 6 to 7 years of...
-
Senior Python/PySpark Developer
1 week ago
Bangalore, India Resource Quick Full timeAbout the Role :We are seeking a highly skilled Senior Python/PySpark Developer to lead our data engineering and analytics initiatives. The ideal candidate will have a proven track record in designing, developing, and deploying robust and scalable data solutions on AWS.Key Responsibilities :Data Engineering :- Develop, test, and deploy efficient data...
-
Data Engineer
4 weeks ago
Bangalore/Hyderabad, India Talent21 Management and Shared Service Pvt Ltd Full timeRequired Skills : - 5+ years' experience, candidate as back end - data engineer. - Strong experience in SQL. - Strong knowledge and experience Python and PySpark. - Experience in AWS. - Experience in Docker and Openshift. - Hands-on experience with REST Concepts. - Design and Develop business solutions on the data front. - Experience in implementation...
-
Data Analyst
1 month ago
Bangalore/Hyderabad, India ANRI Solutions HR Services Full timeJob Description : We are looking for a Data Analyst with 4-8 years of experience who is proficient in Python and PySpark. The successful candidate will analyze large datasets to extract meaningful insights and support data-driven :- Analyze and interpret complex data sets using Python and PySpark.- Develop and maintain dashboards and reports to visualize...
-
Valiance Solutions
1 month ago
Bangalore/Noida, India Valiance Analytics Pvt. Ltd. Full timeJob Description Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team...
-
Principal Data Engineer
1 month ago
Bangalore, India gethyr Full timeResponsibilities : Data Pipeline Development : Design, implement, and maintain scalable data pipelines using PySpark to process and transform large datasets efficiently. Workflow Orchestration : Develop, schedule, and monitor complex data workflows and ETL processes using Apache Airflow. Data Management : Manage and optimize data storage solutions,...
-
Python / pyspark developer
2 months ago
Bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, Data Frames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence...
-
Senior Data Engineer
4 weeks ago
Bangalore, India BYTESPRINT TALENT SEARCH LLP Full timeRole Overview :- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the...
-
Python / Pyspark developer
4 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...
-
Python / Pyspark developer
2 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...
-
Azure Data Engineer
3 weeks ago
Bangalore, India Juniper Consultancy Services Full timeWho are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...
-
Python / Pyspark developer
4 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in programming...
-
Python / Pyspark developer
4 months ago
bangalore, India Tata Consultancy Services Full timeJD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in...