Senior Data Engineer

3 months ago


Solapur, India VidPro Consultancy Services Full time

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience: 3-15 years

Location: Bangalore, Chennai, Delhi, Pune, Kolkata and Gurgaon

Mandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory


Primary Roles and Responsibilities:


Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:


● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 3+ yrs. of experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data.

● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.



  • Solapur, Maharashtra, India Unico Connect Full time

    Job SummaryWe are seeking a highly skilled Senior Data Strategist to join our innovative team at Unico Connect. As a key member of our data science group, you will play a critical role in shaping data-driven strategies that drive business success.

  • Data Engineer

    1 week ago


    Solapur, India Truelancer.com Full time

    Job Title: AWS Data EngineerExperience: 8-12 YrsMust Have Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWSRequired Skills:8-12 years of experience in Data EngineeringCreation and maintenance of optimum data pipeline architecture for ingestion, processing of dataCreation of necessary infrastructure for ETL jobs from a wide range of...


  • Solapur, India Black Panda Enterprises Full time

    Join Forage AI as a Senior Data Specialist. If you’re a detail-oriented, communication, and research-savvy professional who loves working with data, then this may be the right role for you!As a senior data specialist, you will play a critical role in managing processes and collaborating with other teams. You will also ensure the accuracy, integrity, and...

  • Data Engineering Lead

    3 weeks ago


    Solapur, Maharashtra, India Azilen Technologies Full time

    Company OverviewAzilen Technologies is a leading technology firm that specializes in data engineering and analytics solutions.Job SummaryWe are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines, ensuring high-quality data...

  • Big Data Engineer

    1 month ago


    Solapur, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...


  • Solapur, India MPC Cloud Consulting Pvt Ltd Full time

    We are looking for Data Analytics Engineers Key Details:Role: Data Analytics Engineer (5-8 years of experience, ability to work independently) Skillset: Azure Data Factory, Azure Synapse Analytics, and other Azure services. SQL Server, Azure SQL Python software development stacks, ecosystems, frameworks, and tools such as NumPy, SciPy, Pandas, sci-kit-learn...

  • Data Science Engineer

    3 weeks ago


    Solapur, India RecourseTech Full time

    Recourse Tech is a dynamic and fast-growing software and technology agency that builds cutting-edge solutions for businesses across industries. We specialize in delivering high-impact, data-driven solutions, leveraging advanced technologies, and empowering organizations with actionable insights.We are looking for a Data Science Engineer with 1-3 years of...


  • Solapur, Maharashtra, India PLMITPro Full time

    Job DescriptionWe are seeking a highly skilled Senior Teamcenter Data Migration Specialist to join our team at PLMITPro.This is a unique opportunity to leverage your expertise in Teamcenter data migration, Requirements Gathering, Solution Design, and implementation knowledge to drive business growth.About the RoleDevelop and implement efficient data...


  • Solapur, India Gravity Infosolutions Full time

    Role: Sr. Data Architect-ContractExperience: 14-20 yearsShift: Regular IST shiftType: ContractDuration: 6 monthsLocation: Mumbai-Hybrid(2 Days Work from Office in a week)Job Description:We are seeking an accomplished Senior Data Architect to join our team and lead our data architecture efforts. As a Senior Data Architect, you will be responsible for...


  • solapur, India SPIRO Full time

    We are looking for an experienced Senior Java Developer to join our dynamic and growing team. The ideal candidate will have a strong background in Java development and a passion for building high-quality software solutions. You will be responsible for designing, developing, and maintaining Java applications that are efficient, reliable, and scalable. Key...


  • Solapur, Maharashtra, India Hexaware Technologies Full time

    Hexaware Technologies is a leading IT consulting and business solutions company that offers end-to-end services to clients worldwide. Our team of experts provides innovative solutions to businesses, helping them achieve their goals and stay ahead in the market.We are seeking an experienced Snowflake Data Engineer who will play a key role in designing,...


  • Solapur, Maharashtra, India Cardinal Health Full time

    About UsAt Cardinal Health, we are a leading distributor of pharmaceuticals and a global manufacturer and distributor of medical and laboratory products. We strive to be the most trusted partner in healthcare by delivering innovative digital solutions and end-to-end services that advance healthcare and improve lives.We have a long history of success, with...


  • Solapur, India Fluidech Full time

    Job Title: Senior Embedded/Platform Software TesterCompany Profile:Fluidech is a technology consulting and managed services firm specializing in infrastructure (cloud & on-premise), automation (DevOps and RPA), and cybersecurity. Our name, 'Fluidech,' reflects our approach—combining 'fluid' with 'technology' to emphasize our adaptable and innovative...

  • Senior Staff Engineer

    5 months ago


    Solapur, India Mulya Technologies Full time

    Senior Staff Engineer - RTL DesignLocation: Bangalore /Pune We enable tomorrow’s future by accelerating the critical data communication at the heart of our digital world – from seamless video streaming to AI to the metaverse and much more. Our technology powers product innovation in the most data-demanding industries today, including data centers,...


  • solapur, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...


  • Solapur, India v4c.ai Full time

    Overview: As the apex of the data science hierarchy, the Principal Data Scientist will set the strategic direction for data-driven initiatives, ensuring alignment with organizational goals, and lead in the adoption of advanced technologies including Machine Learning, Deep Learning, and Generative AI.Job Description:Strategically lead the planning and...

  • Data Governance

    2 months ago


    Solapur, India Deloitte Full time

    We are looking for Candidates who are having experience as Data GovernanceExperience Required: 3 - 20 years.Location: PAN IndiaResponsibilities:--Expertise: Data Governance Senior Manager- Minimum of 12 years of experience in data management and data governance and must have knowledge in informatica EDC or Axon- Demonstrated management of strategic and...

  • Data Modeler

    7 days ago


    Solapur, India Akshya Patra Services Full time

    We are seeking a highly skilled and experienced Data Modeller to join our growing data team.In this role, you will be responsible for designing and developing robust and scalable data models that effectively capture and represent business information.You will work closely with data engineers, analysts, and business stakeholders to translate complex business...

  • Data Analyst

    4 weeks ago


    Solapur, India snooplay.in Full time

    Location: Noida (Full time)Education: B.Tech (preferred)About Snooplay:Snooplay is India’s leading marketplace for toys and games, where data drives every decision. With multiple data nodes fueling our platform, we rely on meaningful insights to improve experiences for parents and children. If you’re passionate about digging into data, deriving patterns,...


  • Solapur, India Intuit Full time

    Embark on a thrilling journey with Intuit, a leader in financial management solutions, as a Mobile Software Developer in our buzzing Bangalore hub. TurboTax, a household name, delivers cutting-edge tax software that makes filing stress-free and straightforward for millions of users across the globe.About Your Team:QuickBooks is the flagship accounting...