Pyspark Architect

10 hours ago

kolkata, India Talent Worx Full time

Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible fordesigning, building, and managing large-scale data processing solutions while leading ateam of data engineers to deliver high-quality outcomes.Key Responsibilities:1. Leadership & Team Management:• Lead and mentor a team of data engineers, ensuring high performance andprofessional growth.• Oversee project timelines, quality, and deliverables for multiple data initiatives.2. Data Engineering & Development:• Design and implement robust data pipelines and workflows using PySpark andHadoop.• Optimize performance and scalability of big data solutions for complex data sets.• Develop and integrate solutions with AWS services for cloud-based data processing.3. Technical Expertise:• Leverage expertise in PySpark, Hadoop, and Scala to solve complex technicalchallenges.• Work with Teradata for large-scale data warehousing solutions.• Utilize data visualization tools (e.g., Tableau, Power BI) to provide insights andreporting solutions.4. Stakeholder Collaboration:• Collaborate with cross-functional teams, including business stakeholders and productmanagers, to understand requirements and deliver solutions.• Provide thought leadership on best practices in big data technologies and architecture.Required Skills & Qualifications:• Technical Expertise:• Proficiency in PySpark, Hadoop, AWS (S3, Glue, EMR, Redshift), and Teradata.• Hands-on experience with Scala for data engineering tasks.• Familiarity with data visualization tools like Tableau, Power BI, or similar platforms.• Experience:• 7–13 years of experience in data engineering, with a focus on big data technologies.• Proven track record of managing end-to-end data engineering projects and leadingteams.• Educational Background:• Bachelor's or Master's degree in Computer Science, Information Technology, or arelated field.• Soft Skills:• Strong analytical and problem-solving skills.• Excellent communication and stakeholder management abilities.• Ability to work in a fast-paced, dynamic environment.Preferred Skills:• Certification in AWS or related big data tools.• Experience in real-time data streaming platforms like Kafka.• Knowledge of DevOps practices, including CI/CD pipelines and infrastructure as code.RequirementsTalent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a Global and leading provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets.

  • Pyspark Architect

    2 weeks ago

    Kolkata, West Bengal, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Pyspark Architect

    2 days ago

    Kolkata, West Bengal, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,KolkataExperience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Apache Spark Pyspark Architect

    2 days ago

    Kolkata, India Mindtree Full time

    JOB SUMMARY A Solutions Architect defines and owns the end-to-end solution architecture and quality attributes of systems to deliver business objectives. They understand business objectives, priorities, and pain areas and incorporate diverse technic al, functional, software and physical requirements to create the solution architecture for an overall program....

  • Pyspark Architect-L

    2 weeks ago

    Delhi, Kolkata, Mumbai, NCR, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job descriptionHiring for Pyspark ArchitectMandatory Skills: PysparkEducation: BE/B.Tech/MCA/M.Tech/MSc./MSResponsibilitiesA day in the life of an InfoscionAs part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis,...

  • Snowflake Architect(Python

    1 week ago

    Hyderabad, Kolkata, Pune, India Alike Thoughts Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Mandatory Skills: Snowflake Architect, Python, PysparkExperience: 8 to 15 yrsLocation: PAN IndiaNotice Period: 60 MaxInterested candidates Please apply.

  • Data Architect

    3 days ago

    Kolkata, West Bengal, India Lexmark International, Inc. Full time

    Responsibilities: About Lexmark: Founded in 1991 and headquartered in Lexington, Kentucky, Lexmark is recognized as a global leader in print hardware, service, software solutions and security by many of the technology industry’s leading market analyst firms. Lexmark creates cloud-enabled imaging and IoT solutions that help customers in more than 170...

  • AWS Glue

    1 week ago

    Kolkata, West Bengal, India Cognizant Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Skill: AWS GlueExperience: 6 to 9 yearsLocation: KolkataJob descriptionTechnical Skills :AWS Glue: 3+ years of hands-on experience in AWS Glue ETL developmentPython/PySpark: Strong programming skills in Python and PySpark for data transformationAWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMRData Formats: Experience with Parquet, Avro,...

  • Data Governance Application Architect

    11 hours ago

    Kolkata, India Vista Applied Solutions Group Inc Full time

    Job Summary:This is a technical role with a strong business acumen requirement; hence it is expected the Integration Architect continuously invests in learning and stays on par with the latest in Data Governance, Analytics, and Data Science approaches, solutions, frameworks, technology offerings, and best practices.Experience:Minimum of 4 years of experience...

  • Azure Platform Architect

    8 hours ago

    Kolkata, India SIRO Full time

    1. 12+ years of IT experience with at least 5+ years in Azure Platform architecture and solution design. 2. Strong experience in Azure IaaS (VMs, networking, storage, identity) and PaaS services. 3. Good to have hands-on experience in Azure Data Platform. Good Understanding of Data Warehousing, 4. Hands-on experience with: 5. IAM 6. Security architecture and...

  • Aws Glue

    3 days ago

    Kolkata, West Bengal, India Cognizant Full time

    **Skill**: AWS Glue **Experience**: 6 to 9 years **Location**: Kolkata **Job description** **Technical Skills**: - AWS Glue: 3+ years of hands-on experience in AWS Glue ETL development - Python/PySpark: Strong programming skills in Python and PySpark for data transformation - AWS Services: Proficiency in S3, Redshift, Athena, Lambda, and EMR - Data...