Senior data engineer

1 week ago

Bhopal, India Texplorers Inc Full time

Company Description Texplorers Inc. is a leader in digital transformation for global enterprises, with over 15 years of experience in cloud technology and AI expertise. The company focuses on empowering businesses to scale efficiently and continuously improve through their innovation ecosystem. Texplorers Inc. is committed to innovation, sustainability, and inclusion, ensuring perpetual learning and growth for their clients. We are seeking candidates who can join us immediately.   We are seeking multiple experienced Data Engineers to design, build, and optimize scalable big data solutions. This role involves developing high-performance ETL pipelines using Apache Spark across major cloud platforms (Azure, AWS, or GCP), with a strong emphasis on data engineering best practices and system performance.   Key Responsibilities:   -  Lead the end-to-end design and optimization of Databricks ETL pipelines to ensure high-quality data delivery. - Develop scalable data ingestion and transformation workflows by leveraging the full power of the Apache Spark framework. - Manage complex data lifecycles involving both structured and unstructured datasets from diverse originating sources. - Fine-tune Spark jobs to balance peak performance with cost-efficiency and long-term scalability. - Establish robust CI/CD patterns and version control standards for all Databricks-based workflows. - Collaborate with stakeholders across engineering, data science, and analytics to translate business needs into technical solutions. -  Enforce rigorous security protocols and access management policies within the Databricks environment. - Diagnose and resolve complex bottlenecks related to big data processing and system scalability. Required Skills: - Proven track record of developing high-performance solutions using Databricks and Apache Spark (proficient in Py Spark, Scala, or Java). - Expert-level command of SQL for complex data modeling, transformation, and analytical querying. - Deep familiarity with cloud ecosystems (Azure, AWS, or GCP), with specific expertise in storage and warehousing solutions like ADLS, S3, or Big Query. - Significant experience building end-to-end ETL/ELT pipelines and managing scalable Data Warehousing environments. - Strong grip on CI/CD pipelines, Git version control, and Dev Ops methodologies tailored for data engineering. - In-depth knowledge of Delta Lake and Lakehouse architecture, with a focus on advanced performance tuning and optimization. - Skilled in managing massive-scale datasets within distributed computing environments. Preferred Skills: - Skilled in leveraging Databricks MLflow to track, deploy, and scale machine learning models. - Familiarity with modern data stack components such as Apache Kafka for streaming, Airflow for workflow automation, or Snowflake for cloud warehousing. - Deep understanding of data privacy standards, access control policies, and corporate compliance requirements.   Education & Experience:   -   Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a strictly related technical discipline. -   5–7 years of specialized experience in Data Engineer and big data architecture. -  Mandatory background in the Retail sector, with a deep understanding of industry-specific data challenges

  • Data Engineer

    3 weeks ago

    Bhopal, India Mirai Alpha Full time

    Job Title: Data Engineer Location: Bangalore Experience: 2–6 years Type: Full-time About the Role We are building a next-generation investment platform that uses high-quality market data and clear, rule-based logic to select securities and build portfolios. Your job is to create the full data foundation from collecting and cleaning data to organising,...

  • Data engineer

    3 weeks ago

    Bhopal, India Canopus Infosystems - A CMMI Level 3 Company Full time

    Job Title:  Data Engineer (Analyst)Experience:  3+ YearsLocation:  PAN India (Remote)About the Role:We are looking for an experienced  Data Engineer (Analyst)  who can design, build, and optimize data models and pipelines to support business intelligence and performance analytics. The ideal candidate should have a strong understanding of  SQL , ...

  • Senior environmental engineer

    3 weeks ago

    Bhopal, India Reliance Industries Limited Full time

    Interested candidates, kindly mail to Main Purpose:The Senior Environmental Engineer is responsible for arranging regular environmental monitoring, assisting in the implementation of environmental permit conditions, and preparing and submitting environmental compliance reports to statutory bodies. The role also involves contributing to Environmental...

  • Data Engineer

    3 weeks ago

    Bhopal, India RWS Group Full time

    Skills & Experience 5+ years of hands-on experience in Microsoft SQL Server development Strong proficiency in SQL Server Integration Services ( SSIS ) Demonstrated experience with Azure cloud services (Azure Data Factory, Azure SQL Database, or related services ) Experience integrating data from various source systems including MySQL, PostgreSQL, Google...

  • Senior consultant

    1 week ago

    Bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4!Role : Senior Consultant - Data Analytics (Public Finance)Designation : Associate / AM / ManagerLocation : BhopalWork Mode : On-siteExperience : 5+ Yrs in Data AnalyticsEducation : Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBAResponsibilities:Worked in at least one project in...

  • Senior Consultant

    1 week ago

    Bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4!Role: Senior Consultant - Data Analytics (Public Finance)Designation: Associate / AM / ManagerLocation: BhopalWork Mode: On-siteExperience: 5+ Yrs in Data AnalyticsEducation: Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBAResponsibilities:Worked in at least one project in...

  • Senior consultant

    7 days ago

    Bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4!Role : Senior Consultant - Data Analytics (Public Finance)Designation : Associate / AM / ManagerLocation : BhopalWork Mode : On-siteExperience : 5+ Yrs in Data AnalyticsEducation : Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBAResponsibilities:Worked in at least one project in...

  • Senior Consultant

    1 week ago

    bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4!Role: Senior Consultant - Data Analytics (Public Finance)Designation: Associate / AM / ManagerLocation: BhopalWork Mode: On-siteExperience: 5+ Yrs in Data AnalyticsEducation: Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBAResponsibilities:- Worked in at least one project in...

  • Senior Consultant

    1 week ago

    Bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4! Role: Senior Consultant - Data Analytics (Public Finance) Designation: Associate / AM / Manager Location: Bhopal Work Mode: On-site Experience: 5+ Yrs in Data Analytics Education: Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBA Responsibilities: - Worked in at least one project...

  • Senior Consultant

    7 days ago

    Bhopal, India Talent Integrators Full time

    Opportunity with one of the Big - 4!Role: Senior Consultant - Data Analytics (Public Finance)Designation: Associate / AM / ManagerLocation: BhopalWork Mode: On-siteExperience: 5+ Yrs in Data AnalyticsEducation: Graduate in any discipline and Masters in Economics/Master in Commerce/MCA/PGDM /PGDBM/MBAResponsibilities:- Worked in at least one project in...