Big Data Lead

3 weeks ago

CoimbatoreAhmedabad, India other Full time

Job Description :

Primary Skills : Databricks with Pyspark, Python

Secondary skills : ADF

- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.

- 4+ years of work experience with very large data warehousing environment

- 4+ years of work experience in Databricks, Pyspark and Python project development work

- Expertise in Bigdata Eco systems like HDFS and Spark

- Strong hands-on experience on Python or Scala.

- Hands on experience on Azure Data Factory.

- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.

- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.

- SQL SERVER development work experience with relational databases and knowledge is a must

- Development of Stored Procedures for transformations in ETL pipeline

- Should have work experience in Agile projects

- Write and maintain documentation of the ETL processes via process flow diagrams.

- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse

- Good experience on customer interaction is required.

- Possesses good interpersonal and communication skills.

(ref:hirist.tech)

  • Big Data Engineer

    3 weeks ago

    ahmedabad, India Paradise Placement Consultancy Full time

    Responsibilities : • Responsible for the architecture planning, design, and core code implementation of the company's monitoring system platform, including product technology pre-research, technology architecture selection, core code writing, design document writing, etc.• Participate in the R&D of the company's big data computing platform,...

  • Technical Lead – React.js

    2 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description:We are looking for a strong ReactJS Lead with 5+ years of experience to join our engineering team at Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Responsibilities:Responsible for providing expertise in software...

  • Big Data Engineer

    2 weeks ago

    Ahmedabad, India Paradise Placement Consultancy Full time

    Responsibilities:• Responsible for the architecture planning, design, and core code implementation of the company's monitoring system platform, including product technology pre-research, technology architecture selection, core code writing, design document writing, etc.• Participate in the R&D of the company's big data computing platform, responsible for...

  • Technical Lead – React.js

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for a strong ReactJS Lead with 5+ years of experience to join our engineering team at Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments. Responsibilities: Responsible for providing expertise in...

  • Technical Lead – React.js

    3 weeks ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for a strong ReactJS Lead with 5+ years of experience to join our engineering team at Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments. Responsibilities: Responsible for providing...

  • Big Data Platform Architect

    7 days ago

    Ahmedabad, India Infinity Business Solutions Full time

    April 28, 2023 **Job Category**:Big Data Platform Architect **Job Type**:Full Time **Job Location**:Ahmedabad **SHIFT**: Morning Shift (AEST- Sydney Time Zone) **EXPERIENCE**: 8+ Yrs **CTC**:8 - 10 Lac/Annum **MAIN DUTIES/RESPONSIBILITIES**: - Responsible for the architecture planning, design, and core code implementation of the company’s monitoring...

  • Big Data Platform Architect

    7 days ago

    Ahmedabad, India Infinity Business Solutions Full time

    **MAIN DUTIES/RESPONSIBILITIES**: - Responsible for the architecture planning, design, and core code implementation of the company's monitoring system platform, including product technology pre-research, technology architecture selection, core code writing, design document writing, etc. - Participate in the R&D of the company's big data computing platform,...

  • Lead Data Engineer

    3 weeks ago

    Coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace...

  • Senior Technical Lead – Python

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for strong technical leads to join our engineering team in Ahmedabad.The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires an understanding of at least one of the technologies such as Data...

  • Technical Lead – Core Java

    2 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description:Crest Data Systems is looking for a Senior Software Engineer – Lead in Core JAVA with 5+ years of experience. The job requirement is mentioned below –Responsibilities:Responsible for providing expertise in software development life cycle, from concept, architecture, design, implementation, & testing.Leading & mentoring small sized...

  • Lead DevOps Engineer

    3 days ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Technical Lead – Python

    3 weeks ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for technical leaders to join our engineering team in Ahmedabad & Pune. The primary responsibility will be to lead,help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in...

  • Technical Lead – Core Java

    3 weeks ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: Crest Data Systems is looking for a Senior Software Engineer – Lead in Core JAVA with 5+ years of experience. The job requirement is mentioned below – Responsibilities: Responsible for providing expertise in software development life cycle, from concept, architecture, design, implementation, & testing. Leading...

  • Wavicle Data Solutions

    3 weeks ago

    Chennai,Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Wavicle Data Solutions

    6 days ago

    Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Lead DevOps Engineer

    2 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Lead DevOps Engineer

    2 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Company Overview: Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...

  • Senior Software Engineer – Python

    3 weeks ago

    ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing...

  • Senior Software Engineer – Python

    3 weeks ago

    Ahmedabad, India Crest Data Systems Full time

    Job Description: We are looking for software engineers to join our engineering team in Ahmedabad. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security and Cloud segments. The job requires expertise on Core & Advanced Python with experience in developing REST...

  • Senior Data Engineer

    3 weeks ago

    coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers’ customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the...