Current jobs related to Senior Data Engineer - Solapur - VidPro Consultancy Services

  • Senior Data Engineer

    1 month ago

    solapur, India Info Services Full time

    Urgent Need of below requirementData Engineer - Offshore Pointers from managers meeting today Must have Skill - Experience with Operating Airflow - Understand how the whole cycle works and have worked on operating it. Many people know airflow, but not everyone knows the operating part. So this person must know that. Work revolves around Airflow in this team....

  • Data Engineer

    4 weeks ago

    solapur, India Fluidata Analytics Full time

    Role Name – Data Engineer (Python) Location- Remote Experience – 2-4 years Notice period – Immediate to 15 days (max) About Fluidata - Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provide end-to-end data engineering and analytics solutions to clients by using cutting-edge data technology and...

  • Data Engineer

    4 weeks ago

    Solapur, India Truelancer.com Full time

    Job Title: Data EngineerExperience: 4+ YearsMandatory Skills: Azure data factory, python, apache-spark, Datalakehouse, Databricks, Should be able to create pipelines and transform dataKey Responsibilities:Design, develop, and maintain end-to-end data pipelines using Azure Data Factory, ensuring the ingestion, transformation, and integration of large...

  • Data Engineer

    1 month ago

    Solapur, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as Data Engineer Role.Experience Required: 7+ years.Location: PAN IndiaResponsibilities:Databricks Development: Design, develop, and optimize Databricks workflows and solutions.Python & PySpark: Write, test, and maintain Python and PySpark code for data processing and analytics.SQL Proficiency:...

  • Data Engineering Manager

    4 weeks ago

    Solapur, Maharashtra, India Technogen, Inc. Full time

    Role: Sr Mgr-Data EngineeringExperience: 13-17 YearsLocation: BangaloreKey Skills: GCP, Big Query, Spark/Kafka/Pyspark/Scala, SQL, People managementAbout the Role:Lead the development and implementation of data engineering solutions using Google Cloud Platform and BigQuery.Design and implement data pipelines and workflow management systems.Collaborate with...

  • Data Engineer

    1 week ago

    Solapur, India Truelancer.com Full time

    Job Title: Data EngineerMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLJDDesign and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks including data cleaning, normalization, deduplication, type...

  • Senior Data Engineer

    1 month ago

    Solapur, India Visa Full time

    Job Description and ResponsibilitiesTeam SummaryVisa Consulting & Analytics (VCA) team is a key part of the Global Solutions organization, a high-performing team of data scientists, data analysts and statisticians helping major organizations adapt and evolve to meet the changes taking place in technology, finance, and commerce, with cutting-edge, creative...

  • Data Engineer

    3 weeks ago

    Solapur, India Truelancer.com Full time

    Job Title: Data EngineerMandatory Skills: Pyspark, Azure, ADF, Databricks, ETL, SQLJob Description:Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksDesign and build ETL pipelines using ADFBuild and maintain a Lakehouse architecture in ADLS / Databricks.Perform data preparation tasks including data cleaning, normalization,...

  • Python Data Engineer

    2 months ago

    solapur, India CredHive Full time

    Position Overview We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for...

  • Senior Data Governance Specialist

    3 weeks ago

    Solapur, India InCommon Full time

    Job Type: Full-Time Location: Remote⏱️ Work Timings: 12 PM to 8 PM IST | Monday to Friday ️ Experience Required: 8-10+ Years of relevant experience⌛ Hiring Timeline: Immediate Hiring Process: Resume review - Initial screen - Technical Interviews (3) - Leadership & Behavior InterviewsAbout the companyInCommon is hiring on behalf of a Canada-based...

  • Test Data Engineer

    1 month ago

    solapur, India EVERSANA Full time

    Experience: 8-10+yearsPrimary Skill: Leadership role, Hands on SQL Data Base. Data mining and data reporting testers Tester| ETL Analyst, ETL Tester.Responsibilities:This individual contributor is responsible for guiding and influencing the development of a formal Data Quality Services Framework and for supporting the development of software quality...

  • GCP Data Engineer

    5 days ago

    Solapur, India True Tech Professionals Full time

    Preference would be given to Engineers who can work from the office in a hybrid role in Gurgaon. Roles/Responsibilities (Candidate’s responsibilities):Experience in Google BigQuery (Including BQ query standards, partitioning/clustering, data-model)Python Programming ExpertSQL knowledgePreferred: Experience in Ascend toolCreate Data flow, Data service, Read...

  • Senior Full Stack Developer

    4 weeks ago

    Solapur, Maharashtra, India SparkCognition Full time

    Senior Full Stack EngineerSparkCognition's Renewable Suite is a leading AI-enabled SaaS platform that provides asset performance management and prescriptive analytics software to renewable energy power plants. As a Senior Full Stack Engineer, you will work closely with team members across domains with deep technical skills and passion for clean energy.Key...

  • Senior Software Engineer

    2 weeks ago

    Solapur, Maharashtra, India Podar Education Network Full time

    About the Role:We are seeking a skilled Senior Software Engineer to join our team. In this role, you will be responsible for designing, developing, and testing software applications.Key Responsibilities:Designing and developing software applications using a variety of programming languages.Collaborating with cross-functional teams to identify and prioritize...

  • Senior Staff Engineer

    4 months ago

    Solapur, India Mulya Technologies Full time

    Senior Staff Engineer - RTL DesignLocation: Bangalore /Pune We enable tomorrow’s future by accelerating the critical data communication at the heart of our digital world – from seamless video streaming to AI to the metaverse and much more. Our technology powers product innovation in the most data-demanding industries today, including data centers,...

  • Senior Staff Software Engineer

    2 months ago

    solapur, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...

  • Senior Quality Assurance Automation Engineer

    3 days ago

    Solapur, Maharashtra, India Norstella Full time

    Job DescriptionWe are seeking an experienced Senior Quality Assurance Automation Engineer to join our team at Norstella. As a key member of our software engineering team, you will be responsible for designing, implementing, and maintaining automated test frameworks and scripts to ensure the quality and reliability of our web and mobile...

  • Data Architect for International Projects

    6 days ago

    Solapur, Maharashtra, India All European Careers Full time

    Job Title: Senior Data Analytics ExpertAbout the Role:We are seeking a skilled Senior Data Analytics Expert to join our team at All European Careers. The ideal candidate will have a strong background in data modeling, ETL development, and data management within a Datawarehouse environment.Key Responsibilities:Assessing customer data requirements and...

  • Full Stack Engineer

    1 month ago

    Solapur, India SparkCognition Full time

    Position Summary:SparkCognition’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as...

  • Senior Generative AI

    1 month ago

    solapur, India VH Mobile Metrics Pvt Ltd., Full time

    Job Title: Senior Generative AI (GENAI) DeveloperLocation: BangaloreWork Type: Hybrid (2 days from office)Hiring Type: PermanentNotice Period: ImmediateJob Description:We are seeking 4 highly skilled Senior Generative AI (GENAI) Developers with expertise in developing and deploying AI solutions on Azure platforms. The ideal candidates will possess strong...

Senior Data Engineer

2 months ago

Solapur, India VidPro Consultancy Services Full time

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect

Experience: 3-15 years

Location: Bangalore, Chennai, Delhi, Pune, Kolkata and Gurgaon

Mandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory


Primary Roles and Responsibilities:


● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack

● Ability to provide solutions that are forward-thinking in data engineering and analytics space

● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

● Triage issues to find gaps in existing pipelines and fix the issues

● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs

● Help joiner team members to resolve issues and technical challenges.

● Drive technical discussion with client architect and team members

● Orchestrate the data pipelines in scheduler via Airflow


Skills and Qualifications:


● Bachelor's and/or master’s degree in computer science or equivalent experience.

● Must have total 3+ yrs. of experience in Data warehouse/ETL projects.

● Deep understanding of Star and Snowflake dimensional modelling.

● Strong knowledge of Data Management principles

● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture

● Should have hands-on experience in SQL, Python and Spark (PySpark)

● Candidate must have experience in AWS/ Azure stack

● Desirable to have ETL with batch and streaming (Kinesis).

● Experience in building ETL / data warehouse transformation processes

● Experience with Apache Kafka for use with streaming data / event-based data

● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)

● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

● Experience working with structured and unstructured data including imaging & geospatial data.

● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot

● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects

● Should have experience working in Agile methodology

● Strong verbal and written communication skills.

● Strong analytical and problem-solving skills with a high attention to detail.