AM-Pyspark Developer
1 week ago
With a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it.
We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line.
We're harnessing the power of technology and humanity to create meaningful transformation that moves us forward in our pursuit of a world that works better for people.
Now, we're calling upon the thinkers and doers, those with a natural curiosity and a hunger to keep learning, keep growing., People who thrive on fearlessly experimenting, seizing opportunities, and pushing boundaries to turn our vision into reality.
And as you help us create a better world, we will help you build your own intellectual firepower. Welcome to the relentless pursuit of better.Welcome to the relentless pursuit of better.
Inviting applications for Process Developer for the role of Assistant Manager, Pyspark DeveloperResponsibilitiesIn this role, the shortlisted candidate will be part of a team delivering business intelligence solutions.
The shortlisted candidate will have to be responsible to- Design and development of large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs.
- Writes ETL (Extract / Transform / Load) processes, designs database systems and develops tools for real-time and offline analytic processing, by integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
- Uses programming in Python & Pyspark to build robust data pipelines and dynamic systems.
- Collaborates with different client teams, to develop and maintain long-term relationships with key stakeholders.
- Deep engagement and consultation with all business teams to understand current and future needs.
- Works with onshore team in establishing design patterns and development standards. Conducts code reviews and oversees unit testing.
- Collaborates between on-shore and offshore teams for project plan, code reviews, QA, and deployments.
- Brainstorm with development team on optimizing existing data-flow, quality and performance tuning, and building proof-of-concepts.
Professional graduate/post-graduate degree in Computer Science or information technology disciplinePreferred skills:
- Subject Matter Expert in Python and it's libraries, ETL pipelines, Web Services.
- Expert level programming experience in Pyspark.
- Experience in designing and developing ETL processes using Pyspark and Python.
- Hands-On in DevOps tools – Github, Maven, Jenkins, Docker and Implementation of CI/CD pipelines
- Experience in any cloud platform.
- Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
Handling entire software lifecycle:
requirement gathering, project planning and status reporting to various stakeholders
- End to End project handling, requirements gathering, designing, and implementing effective pipelines.
-
AM-Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Genpact Full timeWith a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world's biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We're harnessing the power of technology and humanity to create...
-
Lead PySpark Developer
1 week ago
Bengaluru, Karnataka, India LTIMindtree Full timeJob Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Manvision Technologies Full timeSNRequired InformationDetails1RolePySpark Developer2Required Technical Skill SetPySpark, Python, HDFS, Hadoop, SQL3No of Requirements024Desired Experience Range5+ yearsLocation of RequirementIndiaDesired Competencies (Technical/Behavioral Competency)Must-HaveSound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured &...
-
Pyspark
1 week ago
Bengaluru, Karnataka, India Riverforest Connections Full timePosition Purpose For the projects which are implemented on Data SSC platform, we need senior developer for python- pyspark development to migrate project from spark/scala to python-pyspark._ResponsibilitiesDirect ResponsibilitiesDesign high quality deliverables adhering to business requirement with defined standards and design principles, patternsDevelop and...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Corporate Resources Full timeJob DescriptionDesigning and developing big data applications using the PySpark framework to meet the needs of the businessWriting and optimizing Spark SQL statements to extract and manipulate large datasetsDeveloping and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processingDebugging and...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Manvision Technologies Full timeSN Required Information Details 1 Role PySpark Developer 2 Required Technical Skill Set PySpark, Python, HDFS, Hadoop, SQL 3 No of Requirements 02 4 Desired Experience Range 5+ years Location of Requirement India Desired Competencies (Technical/Behavioral Competency) Must-Have Sound...
-
Pyspark Developer
1 week ago
Bengaluru, Karnataka, India Corporate Resources Full timeJob Description Designing and developing big data applications using the PySpark framework to meet the needs of the business Writing and optimizing Spark SQL statements to extract and manipulate large datasets Developing and deploying Spark algorithms to perform data processing and analytics tasks, such as machine learning and graph processing ...
-
Bigdata + Pyspark
1 week ago
Bengaluru, Karnataka, India Impetus Technologies Full timeBIgdata + Pyspark :Big Data; Hadoop / HDFS,Pyspark,PythonExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software developmentProficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...
-
Bigdata + Pyspark
1 week ago
Bengaluru, Karnataka, India Impetus Technologies Full timeBIgdata + Pyspark : Big Data; Hadoop / HDFS,Pyspark,Python Experience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL) as appropriateHands-on expertise with application design, software development Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and...
-
Python+Pyspark
1 week ago
Bengaluru, Karnataka, India Wissen Full timeWissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...
-
Python Pyspark Lead
1 week ago
Bengaluru, Karnataka, India Virtusa Full timePython Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...
-
Pyspark
1 week ago
Bengaluru, Karnataka, India Black & White Business Solutions Full timeJob Information:IndustryIT Services***ProvinceKarnataka***CityBangalore North***Postal Code560001***CountryIndiaJob title:Pyspark DeveloperYears ofEXP:6+yearsLocation:Bangalore/Hyderabad/ChennaiNP:Immediate
-
Lead Pyspark Developer
1 week ago
Bengaluru, Karnataka, India LTIMindtree Full timeJob Description:Primary Skill Set:Lead Py Spark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using Py Spark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data pipelines using Py...
-
Aws Pyspark
1 week ago
Bengaluru, Karnataka, India Cognizant Full timeMandatory skills AWS, Python and PySpark, Spark SQL, NoSQL Data BricksExperience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.Hands on experience with EMR Apache Spark...
-
PySpark Data Engineer
1 week ago
Bengaluru, Karnataka, India Edstem Technologies Full timeWe are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work inLocation: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...
-
Pyspark Developer-6 to 8years-chennai
1 week ago
Bengaluru, Karnataka, India Black & White Business Solutions Full timeJob Information:IndustryIT Services***ProvinceKarnataka***CityBangalore North***Postal Code560001***CountryIndiaJob title:Pyspark DeveloperYears ofEXP:6 to 8yearsLocation:ChennaiNP:30Days/ImmediateExcellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service. - Structured and...
-
AWS Data Engineer with PySpark
1 week ago
Bengaluru, Karnataka, India NAM Info Inc Full timeAWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...
-
AWS Data Engineer with PySpark
1 week ago
Bengaluru, Karnataka, India NAM Info Inc Full timeAWS Data Engineer with PySparkDomain: Clinical / pharma/ healthcareLocation: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills:AWS and Python and or PySparkAWS Redshift, Aurora, AWS Glue, AWS Lambda, etc.Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS CloudSpark...
-
AMS Verification
1 week ago
Bengaluru, Karnataka, India Texas Instruments Full timeBasic Qualifications:1-2 years of experience in AMS design verificationto develop verliog/verilogA/verilogAMS models for signal and power management modules, to support Top level verificationexperience in full chip DV will be an added advantageto contribute to development of Full-Chip AMS -DV plan & own significant pieces of this ability to drive best...
-
AMS Verification
1 week ago
Bengaluru, Karnataka, India Texas Instruments Full timeBasic Qualifications: 12 years of experience in AMS design verification- to develop verliog/verilogA/verilogAMS models for signal and power management modules, to support Top level verification- experience in full chip DV will be an added advantage- to contribute to development of Full-Chip AMS DV plan & own significant pieces of this verification.- and...