Pyspark
2 weeks ago
Skill: Pyspark
Experience: 6 to 9 years
Location: Kolkata
Job description: Responsibilities
- Develop and maintain scalable data pipelines using Python and PySpark.
- Collaborate with data engineers and data scientists to understand and fulfill data processing needs.
- Optimize and troubleshoot existing PySpark applications for performance improvements.
- Write clean, efficient, and well-documented code following best practices.
- Participate in design and code reviews.
- Develop and implement ETL processes to extract, transform, and load data.
- Ensure data integrity and quality throughout the data lifecycle.
- Stay current with the latest industry trends and technologies in big data and cloud computing.
Qualifications
- Proven experience as a Python Developer with expertise in PySpark.
- Strong understanding of big data technologies and frameworks.
- Experience with distributed computing and parallel processing.
- Proficiency in SQL and experience with database systems.
- Solid understanding of data engineering concepts and best practices.
- Ability to work in a fast-paced environment and handle multiple projects simultaneously.
- Excellent problem-solving and debugging skills.
- Strong communication and collaboration abilities.
-
Python + Pyspark + SQL
5 days ago
Kolkata, West Bengal, India Talent Worx Full time ₹ 40,00,000 - ₹ 80,00,000 per yearOur Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...
-
Azure Synapse, Azure Databricks with Pyspark
6 days ago
Kolkata, West Bengal, India Cognizant Technology Solutions Full time ₹ 6,00,000 - ₹ 15,00,000 per yearJob Title: - Azure Synapse, Azure Databricks with PysparkLocation: AIA-KolkataJob Type 3 days from office (Hybrid)Minimum 6 to 13 years of experienceMandatory Skills: Azure Databricks with PYSPARK/ Azure SynapseAt least 4 years of experience in Big Data\Distributed computing implementation as a developer.Working knowledge of Data Warehousing concepts and...
-
Azure Databricks with Pyspark
6 days ago
Kolkata, West Bengal, India Cognizant Technology Solutions Full time ₹ 5,00,000 - ₹ 12,00,000 per yearSkill: Azure Databricks with PysparkExperience: 6 to 13 YrsLocation: AIA KolkataJob descriptionResponsibilities:Designing, building, and deploying data pipelines and workflows using Databricks.Developing and optimizing Apache Spark applications for data processing and analytics.Integrating Databricks with various data sources and platforms.Implementing data...
-
Azure databricks, PySpark
2 weeks ago
Kolkata, West Bengal, India Risk Resources LLP Full time ₹ 8,00,000 - ₹ 12,00,000 per yearMust have experience in Object oriented programming, data structures, dependency injection and multi-threading or background in ETL, RDBMS· Experience in Cloud Data Warehouse tools (Azure Data Factory & Azure Databricks)· Experience working with "GIT" as source control and should understand the concepts around pull requests, branches, repositories.·...
-
AWS/ Azure Data Engineer
2 weeks ago
Kolkata, West Bengal, India Talentico Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year•Exp of unified data platform,Data lifecycle starting from Data Ingestion, Transformation, Serve and consumption.• Must have excellent coding skills in Pyspark,Spark sql.• Must be strong in SQL and sprak-sql.Expin Data Engineering domain.•
-
AWS Glue
2 weeks ago
Kolkata, West Bengal, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearSkill: AWS GlueExperience: 6 to 9 yearsLocation: KolkataJob descriptionTechnical Skills :AWS Glue: 3+ years of hands-on experience in AWS Glue ETL developmentPython/PySpark: Strong programming skills in Python and PySpark for data transformationAWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMRData Formats: Experience with Parquet, Avro,...
-
Cloud Engineering Professional
2 weeks ago
Kolkata, West Bengal, India Lexmark Full time ₹ 8,00,000 - ₹ 24,00,000 per yearLexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...
-
Cloud Engineering Professional
2 weeks ago
Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...
-
Cloud Engineering Professional
2 weeks ago
Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...
-
AWS Data Engineer_CBS
1 week ago
Kolkata, West Bengal, India Coders Brain Technology Full time ₹ 5,00,000 - ₹ 15,00,000 per yearLocation: Pune/kolkata Skillset we are looking for: 6+ experience with Cloud technologies, especially AWS services (S3, Athena, Glue, DynamoDB, Step Functions, etc). Strong understanding of Redshift, EMR, Athena, Aurora, Kinesis, Lambda, EC2, Python etc. Must have Technical strength in SQL, Cloud Technologies, ETL development and data warehousing.. Ensure...