Senior Data Engineer

3 weeks ago

Any Location, India Coders Brain Technology Pvt. Ltd. Full time

Position Name : Sr Data Engineer

Experience Required : 8+years

Salary : As per the Market Standard or Else whatever budget you have

Notice period : Immediate joiner

Job Type : Full time

Location : Remote

Job Description :

Solution Architect (Databricks) :

Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+ years as a Big Data architect/solution architect (on Big data platforms) , in which at least 3+ years of Proven experience as Architect/solution architect or a similar role on Databricks platform.


Excellent hands-on experience in architecting and implementing data processing, data warehousing, and data analytics solutions on the Aws Databricks platform having huge data volume, a variety of data types, for batch and real-time data ingestion.

Responsibilities :

- Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.

- Proactively guide engineering methodologies, standards, and leading practices.

- Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.

- Provide guidelines in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing, and Data Governance

Required Skills :

- Must have 9+ years of experience in Data Engineering project development/design handling huge data, in which at least 5+ years on cloud using cloud data engineering services (preferably on aws)

- Must have designed and implemented at least 2-3 projects end-to-end in Databricks, E2E architecture of unified data platform covering all the aspect of data lifecycle starting from Data Ingestion, Transformation, Serve and consumption, understand composable architecture to take fullest advantage of Databricks capabilities.


- Must have Implemented and configured the Databricks environment, including clusters, notebooks, and libraries, ensuring optimal performance and resource utilization.

- Must have followed various architectural principles to design best suited per problem.


- Must have Designed and developed scalable designing both Batch and streaming data pipeline , data lake architectures, and data warehousing solutions on the Databricks platform using Spark and Delta Lake.

- Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.

- Must have a strong understanding of Data warehousing and various governance and security standards around Databricks.

- Must have knowledge of cluster optimization and its integration with various cloud services, strong performance optimization skills to improve efficiency and reduce cost.

- Must be strong in writing unit test cases and integration test and Responsible to set best practices around Databricks CI/CD.


- Must have Integrated data from various sources, including structured, semi-structured, and unstructured data, into Databricks for processing and analysis.

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Data Engineer

    5 days ago

    Any Location, India SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview :As a Senior Data Engineer, you will be responsible for architecting,...

  • Senior Data Engineer

    3 weeks ago

    Any Location, India Innova ESI Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This is a remote-first position, offering you the flexibility to work from anywhere while collaborating effectively with colleagues. In this role, you will play a key role in the entire data lifecycle, from designing and implementing data pipelines...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Innova ESI Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This is a remote-first position, offering you the flexibility to work from anywhere while collaborating effectively with colleagues. In this role, you will play a key role in the entire data lifecycle, from designing and implementing data pipelines...

  • SportsGameX - Senior Data Engineer - ETL

    2 weeks ago

    Any Location, India SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview : As a Senior Data Engineer, you will be responsible for architecting,...

  • SportsGameX - Senior Data Engineer - ETL

    5 days ago

    Any Location, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview : As a Senior Data Engineer, you will be responsible for architecting,...

  • Senior Backend Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...

  • Senior Backend Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Backend Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed...

  • Senior Backend Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Data Engineer

    5 days ago

    Any Location, India Staffington Consulting Pvt Ltd Full time

    Mandatory Skills : Data engineer , AWS Athena, AWS Glue, Redshift, Datalake, Lakehouse, Python, SQL ServerMust Have Experience: 6+ years of hands-on data engineering experience Expertise with AWS services: S3, Redshift, EMR, Glue, Kinesis, DynamoDB Building batch and real-time data pipelines Python, SQL coding for data processing and analysis Data modeling...

  • Senior Data Engineer

    3 weeks ago

    Chennai/Any Location, India mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek...

  • Senior Data Engineer

    3 weeks ago

    Chennai/Any Location, IN mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek a...

  • Senior Data Engineer

    1 month ago

    Chennai/Any Location, IN mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek a...

  • Senior Data Engineer

    1 month ago

    Chennai/Any Location, India mlesystems Full time

    Job Title: Senior Data Engineer - Airflow Location: Chennai (Remote) Company Overview: MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making. We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights. We seek...

  • Senior Data Engineer

    2 weeks ago

    Any Location, India UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...