Python / Pyspark/ Databricks Senior Data Engineer (developer)

1 week ago

Pune, Maharashtra, India Exusia Full time

Sr Data Engineers Tech Leads Python Pyspark DatabricksDepartment Sales and Delivery Team - EmpowerIndustry Information Technology Services Computer Software Management ConsultingLocation WFH India RemoteExperience Range 6 - 10 yearsBasic Qualification Bachelor of Engineering or EquivalentTravel Requirements Not requiredWebsite Exusia a cutting-edge digital transformation consultancy and is looking for top talent in Data Engineering space with specific skills in Python Pyspark Databricks to join our global delivery team s Industry Analytics practice in India Whats the Role Full-time job to work with Exusia s clients to design develop and maintain large scale data engineering solutions The right candidates will also get a chance to work across the entire data landscape including Data Governance Metadata Management and will work closely with client stakeholders to capture the requirements design and implement Analytical reporting Compliance and Data Governance solutions Criteria for the Role xefxbbxbfxc2xb7 Have a minimum of 6 years experience in Data Management Data Engineering Data Governance space with hands on project experience using Python Pyspark Databricksxc2xb7 Should have worked on large data initiatives and should have exposure to different flavours of Spark including Pyspark Spark SQL Scala Javaxc2xb7 Education Qualification Bachelor of Science preferably in Computer and Information Sciences or Business Information Technology or an Engineering degree in the above areasxefxbbxbfKey Responsibilities xc2xb7 Work with business stakeholders to gather and analyze business requirements building a solid understanding of the Data Analytics and Data Governance domainxc2xb7 Document discuss and resolve business data and reporting issues within the team across functional teams and with business stakeholdersxc2xb7 Should be able to work independently and come up with solution designxc2xb7 Build optimized data processing and data governance solutions using the given toolsetxc2xb7 Provide hands on technical leadership and work on multiple projects if requiredxc2xb7 Collaborate with delivery leadership to deliver projects on time adhering to the quality standardsxc2xb7 Contribute to talent recruitment competency building and providing mentor-ship to junior resources for these skillsMandatory Skills xc2xb7 Must have strong Data Warehousing Data Engineering backgroundxc2xb7 Strong conceptual understanding of Data Management Data Governance principlesxc2xb7 Experience working with multiple databases like Oracle SQL Server Other DBsxc2xb7 Exposure to Microsoft Azure storage and compute services and should have hands on experience with Databricks on Azurexc2xb7 Hands-on experience using Python and Pyspark and should have completed min 2 projectsxc2xb7 Hands-on experience using Databricks and should be fluent with Pyspark Spark SQLxc2xb7 Exposure to Delta lakexefxbbxbfNice-to-Have Skillsxc2xb7 Exposure to BFSI domain and Data Governance is a big plusxc2xb7 Exposure to Java Scalaxc2xb7 Understanding of data governance tools like ASG Collibra is an added advantagexc2xb7 Exposure to cloud platforms like AWS Azure GCPExusia is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business outcomes and providing strategy and execution capabilities around digital analytics and cloud solutions The company has established its leadership position by solving some of the world s largest and most complex data engineering and analytical problems in the healthcare financial telecommunications consumer products and high technology industries Exusias mission is to transform the world through the innovative use of information Over the past 3 years Exusia was recognized by Inc 5000 and by Crains publications as one of the fastest growing privately held companies in the world Since the companys founding in 2012 Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas Asia and Africa Exusia has recently also been recognized by publications such as the CIO Review Industry Era Insight Success and the CIO Bulletin for the companys innovation in IT Services the Telecommunications and Healthcare industries and it s entrepreneurship The company is headquartered in Miami Florida United States with development centers in India Interested applicants should apply by forwarding their CV to Exusia

  • Python | Pyspark| Databricks

    4 weeks ago

    Pune, Maharashtra, India Michael Page Full time

    About Our ClientOur client is an international professional services brand of firms, operating as partnerships under the brand. It is the second-largest professional services network in the world.Job DescriptionTotal Exp- 6+yearsKey Responsibilities:- Develop and optimize ETL pipelines using PySpark and Databricks.- Work with large-scale datasets and build...

  • Netscribes - Data Engineer - Python/PySpark

    4 weeks ago

    Pune, Maharashtra, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Responsibilities :- Develop & Optimize Data Pipelines - Design, build, and optimize scalable data processing pipelines using Apache Spark.- Performance Tuning - Implement Spark & SQL optimization techniques for enhanced efficiency.- Data Transformation - Leverage SQL & PySpark functions for complex data manipulation and transformation.- Collaboration - Work...

  • Netscribes - Data Engineer - Python/PySpark

    4 weeks ago

    Pune, Maharashtra, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Responsibilities :- Develop & Optimize Data Pipelines - Design, build, and optimize scalable data processing pipelines using Apache Spark.- Performance Tuning - Implement Spark & SQL optimization techniques for enhanced efficiency.- Data Transformation - Leverage SQL & PySpark functions for complex data manipulation and transformation.- Collaboration - Work...

  • Data Engineer with Databricks Expertise

    3 days ago

    Pune, Maharashtra, India Capgemini Full time

    At Capgemini, we are seeking a highly skilled Data Engineer with Databricks Expertise to join our team. As a Python developer with a strong background in data processing and analysis, you will be responsible for designing, developing, and maintaining scalable data pipelines using Python and Databricks (PySpark). Your expertise in cloud services, DevOps...

  • Senior Data Scientist with Databricks Experience

    6 days ago

    Pune, Maharashtra, India LTIMindtree Full time

    As a Senior Data Scientist with Databricks experience, you will lead the design and implementation of advanced data analytics solutions on the AWS platform. Our ideal candidate has a strong background in machine learning, statistics, and data engineering.Key Responsibilities:Design and develop predictive models using Databricks and AWS servicesDevelop and...

  • Data Engineer

    7 days ago

    Pune, Maharashtra, India LTIMindtree Full time

    We are looking for a highly skilled data engineer to join our team at LTIMindtree. As an AWS Databricks Engineer, you will play a key role in designing and implementing scalable data architectures on the AWS platform.Responsibilities:Design and develop data pipelines using Databricks and AWS servicesDevelop and maintain high-quality code in Python and...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Trigent Software Pvt. Ltd Full time

    Senior Data Engineer. Location : Hyderabad, Bangalore, Pune (Hybrid). Experience : 6 years overall, 4 years relevant. Job Description : We are looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Databricks, Python/PySpark, and SQL to join our team. The ideal candidate will play a key role in designing, building, and optimizing...

  • Senior Data Engineering Professional

    6 hours ago

    Pune, Maharashtra, India Populace World Solutions Full time

    The Position:We are looking for a Senior Data Engineering Professional to join our team at Populace World Solutions. The ideal candidate will have 5+ years of experience in big data engineering, with expertise in Python, PySpark, Hadoop, Apache Spark, Databricks, Delta Tables, and AWS data analytics services.Main Responsibilities:Design and implement...

  • AWS Databricks Engineer

    4 days ago

    Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a skilled professional to work with us on AWS and Databricks projects. Our ideal candidate will have 4-12 years of experience in the field. The role is open to applicants from all our global locations. Key skills for this position include: AWS Databricks Pyspark SQL Python About This Role In this role, you will be working with...

  • Data Architect

    2 days ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Limited Full time

    Job DescriptionJob Duties: Role: Data ArchitectJob Description:Work as Data architect/Senior data engineer to design and develop cost effective and reliable data solutions on any cloud platform like Azure or AWS.Should be able to understand client requirements and convert them into technical solution leveraging cloud capabilities and modern...

  • Senior Data Engineer

    14 hours ago

    Pune, Maharashtra, India NETSCRIBES DATA INSIGHTS PRIVATE LIMITED Full time

    Job OverviewWe are seeking an experienced Data Engineer to design and implement large-scale data pipelines using Apache Spark, ensuring efficient and scalable data processing.The ideal candidate will have hands-on experience with Databricks (Delta Lake Architecture, Unity Catalog), a strong knowledge of Python and PySpark, and excellent communication...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Trigent Software - Professional Services Full time

    Senior Data Engineer Location: Hyderabad, Bangalore, Pune (Hybrid) Experience: 6+ years overall, 4+ years relevantJob Description:We are looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Databricks, Python/PySpark, and SQL to join our team. The ideal candidate will play a key role in designing, building, and optimizing scalable...

  • AWS and Databricks Developer Position

    6 days ago

    Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is seeking a talented AWS and Databricks developer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing innovative data solutions on the AWS platform.Key Responsibilities:Design and develop data models and data pipelines using Databricks and AWS servicesDevelop and maintain...

  • Azure Data Engineer

    2 weeks ago

    Pune, Maharashtra, India VidPro Consultancy Services Full time

    Job DescriptionLocation: Hyderabad, Bangalore and PuneExperience: 3-12 YearsWork Mode: HybridMandatory Skills: Python, Pyspark, Airflow, Databricks, ETL, Data Pipelines, and Azure Databricks, Synapse, Data Factory and Data Lake,SQL,ArchitectOverviewWe are seeking a skilled and motivated Data Engineer with experience in Python, SQL, Azure, and cloud-based...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Trigent Software - Professional Services Full time

    Senior Data EngineerLocation:Hyderabad, Bangalore, Pune (Hybrid)Experience:6+ years overall, 4+ years relevantJob Description:We are looking for aSenior Data Engineerwith expertise inAzure Data Factory, Azure Databricks, Python/PySpark, and SQLto join our team. The ideal candidate will play a key role in designing, building, and optimizing scalable data...

  • Databricks Technical Lead

    7 days ago

    Pune, Maharashtra, India Tredence Inc. Full time

    About the Job: Tredence Inc. is seeking a highly skilled Databricks Architect to join our team.The ideal candidate will have 6+ years of IT experience and 3+ years of experience in Data Warehouse/ETL projects.Responsibilities include developing Modern Data Warehouse solutions using Databricks and AWS/Azure Stack, providing forward-thinking solutions in data...

  • Databricks Solutions Architect

    4 days ago

    Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is looking for an experienced data engineer to join our team and contribute to the development of innovative data solutions using AWS and Databricks.The successful candidate will have 4-12 years of experience in data engineering and will be able to apply their skills in Pyspark, SQL, and Python.About This RoleThis role involves working with...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Ascendion Full time

    Job Title: Data Engineer We are seeking a skilled Data Engineer with 3-5 years of experience to design, develop, and maintain robust data pipelines. About the Role Leverage Azure technologies (Synapse, Data Factory, Databricks) to extract, transform, and load data from various sources into target systems. Utilize expertise in SQL, Python, PySpark, and data...

  • Databricks Architect

    2 weeks ago

    Pune, Maharashtra, India Tredence Inc. Full time

    Role: Databricks Technical Lead/ Data Architect This position is responsible for developing and implementing data engineering and analytics solutions using Databricks, AWS, and Azure Stack. The ideal candidate will have a strong understanding of modern data warehousing concepts, dimensional modeling, and data management principles. Suitable candidates...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Trigent Software - Professional Services Full time

    Data EngineerMax Offered CTC : 22 Lacs (Annual)Location: Hyderabad, Bangalore, Pune (Hybrid)Experience: 6+ years overall, 4+ years relevantJob Description:We are looking for a Senior Data Engineer with expertise in Azure Data Factory, Azure Databricks, Python/PySpark, and SQL to join our team. The ideal candidate will play a key role in designing,...