Senior Data Engineer

3 hours ago


Vadodara, Gujarat, India Reflik Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title: Senior Data Engineer

Basic Function

The Senior Data Engineer should be an expert familiar with all areas of data warehousing technical components (e.g., ETL, Reporting, Data Model), connected infrastructure, and their integrations. The ideal candidate will be responsible for developing the overall architecture and high-level design of the data schema environment. The candidate must have extensive experience with Star Schemas, Dimensional Models, and Data Marts. The individual is expected to build efficient, flexible, extensible, and scalable ETL design and mappings. Excellent written and verbal communication skills are required as the candidate will work very closely with diverse teams. A wide degree of creativity and latitude is expected. This position reports to the Manager of Data Services.

Typical Requirements

Requires strong technical and analytical skills, data management expertise, and business acumen to achieve results. The ideal candidate should be able to deep dive into data, perform advanced analysis, discover root causes, and design scalable long-term solutions using Databricks, Spark, and related technologies to address business questions. A strong understanding of business data needs and alignment with strategic goals will significantly enhance effectiveness. The role requires the ability to prepare high-level architectural frameworks for data services and present them to business leadership. Additionally, the candidate must work well in a collaborative environment while performing a variety of detailed tasks daily. Strong oral and written communication skills are essential, along with expertise in application design and a deep understanding of distributed computing, data lake architecture, and relational database concepts. This position requires the ability to leverage both business and technical capabilities regularly.

Essential Functions

  1. Gather, structure, and process data from various sources (e.g., transactional systems, third-party applications, cloud-based financial systems, customer feedback, etc.) using Databricks and Apache Spark to enhance business insights.
  2. Develop and enforce standards, procedures, and quality control measures for data analytics in compliance with enterprise policies and best practices.
  3. Partner with business stakeholders to build scalable data models and infrastructure, leveraging Databricks' Delta Lake, MLflow, and Unity Catalog.
  4. Identify, analyze, and interpret complex data sets to develop insightful analytics and predictive models.
  5. Utilize Databricks to design and optimize data processing pipelines for large-scale data ingestion, transformation, and storage.
  6. Ensure data infrastructure completeness and compatibility to support system performance, availability, and reliability requirements.
  7. Architect and implement robust data pipelines using PySpark, SQL, and Databricks Workflows for automation.
  8. Provide input on technical challenges and recommend best practices for data engineering solutions within Databricks.
  9. Design and optimize data models for analytical and operational use cases.
  10. Develop and implement monitoring, alerting, and logging frameworks for data pipelines.
  11. Lead the architecture and implementation of next-generation cloud-based data solutions.
  12. Build scalable and reliable data integration pipelines using Databricks, SQL, Python, and Spark.
  13. Mentor and develop junior team members, fostering a data-driven culture within the organization.
  14. Develop high-quality, scalable data solutions to support business intelligence, analytics, and data science initiatives.
  15. Interface with technology teams to extract, transform, and load (ETL) data from diverse data sources into Databricks.
  16. Continuously improve data processes, automating and simplifying workflows for self-service analytics.
  17. Work with large, complex data sets to solve non-routine analysis problems, applying advanced machine learning and data processing techniques as needed.
  18. Prototype, iterate, and scale data analysis pipelines, advocating for improvements in Databricks data structures and governance.
  19. Collaborate cross-functionally to present findings effectively through data visualizations and executive-level presentations.
  20. Research and implement advanced analytics, forecasting, and optimization methods to drive business outcomes.
  21. Stay up to date with industry trends and emerging Databricks technologies to enhance data-driven capabilities.

Specialized Skills or Technical Knowledge

  • Bachelor's degree or higher in a quantitative/technical field (e.g., Computer Science, Statistics, Engineering). A Master's degree in Computer Science, Mathematics, Statistics, or Economics is preferred.
  • 5+ years of experience in data engineering, business intelligence, or data analytics, with a focus on Databricks and Apache Spark.
  • Extensive experience with SQL and Python for developing optimized queries and data transformations.
  • Expertise in Databricks ecosystem, including Delta Lake, ML flow, and Databricks SQL.
  • Experience in designing and implementing ETL/ELT pipelines on Databricks using Spark and cloud-based data platforms (Azure Data Lake, AWS S3, or Google Cloud Storage).
  • Strong data modeling, data warehousing, and data governance knowledge.
  • Experience in working with structured and unstructured data, including real-time and batch processing solutions.
  • Familiarity with data visualization tools such as Power BI, Tableau, or Looker.
  • Deep understanding of distributed computing, scalable data architecture, and cloud computing frameworks.
  • Hands-on experience with CI/CD pipelines, Infrastructure as Code (IaC), and DevOps practices in data engineering.
  • Proven track record of working with cross-functional teams, stakeholders, and senior management to deliver high-impact data solutions.
  • Knowledge of machine learning and AI-driven analytics is a plus.
  • Strong problem-solving skills and the ability to work independently and in a team-oriented environment.
  • Excellent communication skills and ability to convey complex data concepts to non-technical stakeholders.
  • Experience in a franchised organization is a plus.


  • Vadodara, Gujarat, India CYAN360 Full time

    Position: Senior AWS Data EngineerLocation: RemoteSalary: OpenWork Timings: 2:30 PM to 11:30 PM IST*** Need someone who can join immediately or in 15 days***Responsibilities:Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.Implement data processing...

  • Data Engineer

    2 weeks ago


    Vadodara, Gujarat, India Allata Full time US$ 1,50,000 - US$ 2,00,000 per year

    Allata is a global consulting and technology services firm with offices in the US, India, and Argentina. We help organizations accelerate growth, drive innovation, and solve complex challenges by combining strategy, design, and advanced technology. Our expertise covers defining business vision, optimizing processes, and creating engaging digital experiences....

  • Senior Data Scientist

    3 weeks ago


    Vadodara, Gujarat, India JK Lucent Full time

    Job Title: Senior Data ScientistExperience: 5+ yearsLocation: Infopark, Koratty, KeralaJob Type: Full TimeJob Summary:We are looking for a highly skilled Senior Data Scientist to join the team at JK Lucent. The ideal candidate will bring a strong background in developing and deploying machine learning models, extracting actionable insights from complex...

  • Senior Data Scientist

    3 weeks ago


    Vadodara, Gujarat, India ValueMatrix Full time

    A Behavioural sciences DeepTech company.Role DescriptionThis is a full-time remote role for a Senior Data Scientist. The Senior Data Scientist will be responsible for performing data analysis, data visualization, and developing data science models. The role involves designing and implementing statistical models, providing insights through data analytics, and...

  • Senior Engineer

    1 week ago


    Vadodara, Gujarat, India Lucy Electric Full time US$ 80,000 - US$ 1,20,000 per year

    Internal Job Title:Senior Design Engineer (Medium Voltage)Company:Lucy Electric Manufacturing & Technologies IndiaLocation:Halol, Vadodara, Gujarat, IndiaJob Reference No:3012We are looking to hire aSenior Design Engineer to support new product engineeringactivities. This will include concept development, detailed design & development of new products,...

  • Data Engineer

    3 weeks ago


    Vadodara, Gujarat, India LTIMindtree Full time

    We are hiring for AWS Data EngineerExperience - 5 to 7 YearsLocation : Chennai Notice period - immediate to 30 daysJob SummarySeeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands...

  • MLOps Engineer

    3 weeks ago


    Vadodara, Gujarat, India Yotta Data Services Private Limited Full time

    Location: Mumbai, IndiaExperience Level: 9 Plus Years Minimum Qualification: Master's Degree in Computer Science, Engineering, or related field.About the Role: We're looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You'll partner with researchers, product teams, and DevOps to...


  • Vadodara, Gujarat, India Velji Ratna Sorathia Infra Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionVelji Ratna Sorathia Infra Pvt. Ltd. specializes in Construction, EPC, and Infrastructure projects, including Roads, Dams, Canals, WTP, STP, ETP, Pipeline Networks, Industrial Areas, Buildings, Landscaping, and Railways. We are committed to delivering high-quality infrastructure solutions and are renowned for our expertise and dedication...

  • Data Engineer

    2 weeks ago


    Vadodara, Gujarat, India Forage AI Full time

    Experience Level: Software Engineer- 3-5 years of relevant experience in data engineering.About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence.Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly...

  • Data Engineer

    4 weeks ago


    Vadodara, Gujarat, India Us Technology International Private Limited Full time

    Role: Data EngineerExperience 3 -6 yearsLocation: Bangalore1.Bachelor's or master's degree in computer science, Data Science, Engineering, or a related field. 2.Proven experience in predictive modeling using Python. 3.Strong analytical and problem-solving skills. 4.Proficiency in MATLAB and Databricks. 5.Familiarity with Python libraries like Matplotlib and...