Current jobs related to Pyspark Architect - Kolkata, West Bengal - Talent Worx

  • Sr. Databricks Architect

    2 days ago

    Kolkata, West Bengal, India Weekday AI Full time US$ 2,40,000 - US$ 7,20,000 per year

    This role is for one of the Weekday's clientsMin Experience: 14 yearsLocation: Bengaluru, Pune, NCR, Hyderabad, Chennai, KolkataJobType: full-time We are looking for an experienced Data Architect with strong expertise in Azure Databricks and modern data engineering practices. The ideal candidate combines technical mastery with a creative and analytical...

  • AWS Glue

    2 weeks ago

    Kolkata, West Bengal, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skill: AWS GlueExperience: 6 to 9 yearsLocation: KolkataJob descriptionTechnical Skills :AWS Glue: 3+ years of hands-on experience in AWS Glue ETL developmentPython/PySpark: Strong programming skills in Python and PySpark for data transformationAWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMRData Formats: Experience with Parquet, Avro,...

  • Cloud Engineering Professional

    2 weeks ago

    Kolkata, West Bengal, India Lexmark Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Lexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...

  • Cloud Engineering Professional

    2 weeks ago

    Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...

  • Cloud Engineering Professional

    2 weeks ago

    Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...

  • Azure Databricks

    2 weeks ago

    Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    TCS Hiring for skill "Azure data Engineer".Role: Azure data EngineerRequired Technical Skill Set: Python, Pyspark, Azure Function, Data bricks, Fast API, FlaskExperience: 6-8 YearsWork Location: Pune, Bangalore,DelhiMust-Have:Expertise in Python programming language and frameworksStrong hands-on with databases (e.g. PostGresSQL/MS SQL/Djangoetc.), web...

  • Data Engineer

    2 weeks ago

    Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    TCS has been a great pioneer in feeding the fire of young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together.TCS Hiring for skill "Data Engineer (Data brick)".Role:Databricks Senior DeveloperRequired Technical Skill Set:Databricks, Spark and Data Migration experienceExperience:4-10...

  • Pyspark Architect

    4 weeks ago

    Kolkata, India Talent Worx Full time

    Job Description: PySpark Architect Location: Bangalore,Pune,Kolkata Experience Required: 7 to 13 Years Role Overview: We are seeking a highly skilled and motivated PySpark Manager to lead our data engineering initiatives. The ideal candidate will have deep expertise in PySpark, Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be...

  • Pyspark Developer

    3 weeks ago

    Kolkata, India Tata Consultancy Services Full time

    TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata locationExperience : 6 - 10 yearsMode of interview: VirtualLocation : Chennai, Hyderabad, KolkataJOB DESCRIPTION:Must have:- Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL.- Experience in design, build and...

  • Data Architect Lead

    4 days ago

    kolkata, India beBeeAzure Full time

    Job DescriptionWe are seeking a skilled professional to lead and architect Azure data solutions for various clients. This role requires expertise in designing, implementing, and maintaining scalable data pipelines using PySpark and SQL. Key Responsibilities:To lead the design, implementation, and maintenance of scalable data pipelines using PySpark and...

  • Senior Data Architect

    3 days ago

    kolkata, India beBeeData Full time

    Job OverviewWe are seeking a highly skilled data expert with strong expertise in cloud computing, big data technologies, and distributed data processing frameworks to design, build, optimize, and manage large-scale data pipelines that support both batch and real-time analytics.Skill Requirements:Design and build scalable, high-performance data pipelines...

  • Cloud Data Architect

    3 days ago

    kolkata, India beBeeBigDataEngineer Full time

    Job Title: Cloud Data ArchitectA cloud-based data engineer with expertise in designing, developing and implementing large-scale data processing pipelines using AWS services and big data technologies.DescriptionWe are looking for a highly skilled Cloud Data Architect to join our team. In this role, you will be responsible for designing, developing and...

  • Data Solutions Architect

    1 day ago

    kolkata, India beBeeDataEngineer Full time

    Job Description:We are seeking a skilled Data Engineer to join our growing data team. The ideal candidate will have strong experience in Python, PySpark, Snowflake, and AWS Glue.The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines that drive business insights and operational efficiency.This...

  • Chief Data Architect

    4 days ago

    kolkata, India beBeeDataScientist Full time

    Data Engineer Role OverviewThis pivotal position lays the foundation for a successful project by providing end-to-end data solutions. Key skills include:Expertise in AWS Data (Pyspark, Glue, Redshift) with hands-on experience in Python programming and PySpark.Experience working with Apache Spark and Hadoop ecosystem.Strong knowledge of database technologies...

  • Carbon Footprint Data Architect

    5 days ago

    kolkata, India beBeeDataEngineer Full time

    Job Opportunity:We are seeking an experienced Data Engineer Lead to join our team and lead the development of data pipelines and models that support product-level carbon footprint analysis.The successful candidate will be responsible for building data pipelines and models using Databricks, integrating structured engineering, manufacturing, and supplier data...

  • Senior Data Architect

    3 weeks ago

    Kolkata, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS !!!TCS is a leading global IT services, consulting, and business solutions organization that delivers real results to global businesses, ensuring a level of certainty no other firm can match.TCS is hiring for GCP Data & Analytics Architect, please find the below JD.Experience range – 8 to 20 yearsLocation - Hyderabad,...

  • Data Governance Application Architect

    4 weeks ago

    Kolkata, India Vista Applied Solutions Group Inc Full time

    Job Summary:This is a technical role with a strong business acumen requirement; hence it is expected the Integration Architect continuously invests in learning and stays on par with the latest in Data Governance, Analytics, and Data Science approaches, solutions, frameworks, technology offerings, and best practices.Experience:Minimum of 4 years of experience...

Pyspark Architect

2 weeks ago

Kolkata, West Bengal, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Description: PySpark Architect

Location: Bangalore,Pune,Kolkata

Experience Required: 7 to 13 Years

Role Overview:

We are seeking a highly skilled and motivated PySpark Manager to lead our data

engineering initiatives. The ideal candidate will have deep expertise in PySpark,

Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible for

designing, building, and managing large-scale data processing solutions while leading a

team of data engineers to deliver high-quality outcomes.

Key Responsibilities:

1. Leadership & Team Management:


• Lead and mentor a team of data engineers, ensuring high performance and

professional growth.


• Oversee project timelines, quality, and deliverables for multiple data initiatives.

2. Data Engineering & Development:


• Design and implement robust data pipelines and workflows using PySpark and

Hadoop.


• Optimize performance and scalability of big data solutions for complex data sets.


• Develop and integrate solutions with AWS services for cloud-based data processing.

3. Technical Expertise:


• Leverage expertise in PySpark, Hadoop, and Scala to solve complex technical

challenges.


• Work with Teradata for large-scale data warehousing solutions.


• Utilize data visualization tools (e.g., Tableau, Power BI) to provide insights and

reporting solutions.

4. Stakeholder Collaboration:


• Collaborate with cross-functional teams, including business stakeholders and product

managers, to understand requirements and deliver solutions.


• Provide thought leadership on best practices in big data technologies and architecture.

Required Skills & Qualifications:


• Technical Expertise:


• Proficiency in PySpark, Hadoop, AWS (S3, Glue, EMR, Redshift), and Teradata.


• Hands-on experience with Scala for data engineering tasks.


• Familiarity with data visualization tools like Tableau, Power BI, or similar platforms.


• Experience:


• 7–13 years of experience in data engineering, with a focus on big data technologies.


• Proven track record of managing end-to-end data engineering projects and leading

teams.


• Educational Background:


• Bachelor's or Master's degree in Computer Science, Information Technology, or a

related field.


• Soft Skills:


• Strong analytical and problem-solving skills.


• Excellent communication and stakeholder management abilities.


• Ability to work in a fast-paced, dynamic environment.

Preferred Skills:


• Certification in AWS or related big data tools.


• Experience in real-time data streaming platforms like Kafka.


• Knowledge of DevOps practices, including CI/CD pipelines and infrastructure as code.

Requirements

Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a Global and leading provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets.