Big Data Lead

2 weeks ago


CoimbatoreAhmedabad, IN other Full time

Job Description :

Primary Skills : Databricks with Pyspark, Python

Secondary skills : ADF

- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.

- 4+ years of work experience with very large data warehousing environment

- 4+ years of work experience in Databricks, Pyspark and Python project development work

- Expertise in Bigdata Eco systems like HDFS and Spark

- Strong hands-on experience on Python or Scala.

- Hands on experience on Azure Data Factory.

- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.

- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.

- SQL SERVER development work experience with relational databases and knowledge is a must

- Development of Stored Procedures for transformations in ETL pipeline

- Should have work experience in Agile projects

- Write and maintain documentation of the ETL processes via process flow diagrams.

- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse

- Good experience on customer interaction is required.

- Possesses good interpersonal and communication skills.

(ref:hirist.tech)
  • Big Data Developer

    2 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Cloud Data Architect

    2 weeks ago


    Chennai/Coimbatore, IN Cloud Destinations Full time

    Job Title : Cloud Data ArchitectExperience : 12 Years - 16 YearsLocation : Chennai/CoimbatoreKey Skills :- Python, Pyspark, Big Data, AWS or Databricks or GCP, ETL, Data Warehousing, and Data Modeling, Cloud solution implementations, Performance Monitoring and Performance improvement measures.Roles & Responsibilities :- Evaluates client business, process,...

  • Project Manager

    2 weeks ago


    Chennai/Coimbatore, IN Resourcetree Full time

    Job Description: We are looking for a skilled and experienced Project Managers to join our team! As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, think strategically, and innovate, and helping others, this job is for you!Primary Skills : Project Management, Agile...

  • Kanerika Software

    2 weeks ago


    Hyderabad/Ahmedabad, IN KANERIKA SOFTWARE PRIVATE LIMITED Full time

    Role :As a Data Engineer Lead / Power BI Lead, your role will involve designing, developing, and implementing interactive dashboards and reports using Power BI. You will work closely with stakeholders to gather requirements and translate them into effective data visualizations that provide valuable insights. Additionally, you will be responsible for...

  • Technical Manager

    2 weeks ago


    Chennai/Coimbatore, IN Cloud Destinations Full time

    Job Title : Technical ManagerExperience : 12 Years - 15 YearsLocation : Chennai/CoimbatoreKey Skills :- Data warehousing, Data lakes, AI/ML, Python, ETL toolsRoles & Responsibilities :- Selecting tools and data architecture- Creating a modern data stack- Communicating with business users- Understanding the scope and requirements of the project and leading...


  • Bangalore/Noida/Coimbatore, IN Worksconsultancy Full time

    Team Leadership and Management:- Lead a team of Data Migration specialists, ensuring they have the necessary skills, resources, and support to execute data migration projects effectively.- Provide guidance, coaching, and mentorship to team members, fostering a collaborative and client-focused work environment.Data Mapping and Transformation:- Develop...


  • Coimbatore/Pune, IN Schlumpbergers Technology India Full time

    Job Description :- Assists MDM leads in the development of the enterprise MDM data model- Configures MDM tools to perform as required by MDM designs- Evaluates and recommends new and emerging MDM/DQ technologies, methodologies and standards- Ensures consistency and compatibility with all other system technology components- Develops the MDM data model and...


  • Bangalore/Mysore/Coimbatore/Any Location, IN Aezion.Inc Full time

    Job Title : Enterprise Data Architect-with Healthcare experienceLocation : :Job Overview :We are looking for a senior Data Architect /data modeler to analyze Healthcare business and data requirements, and model data structures to enable the technical solution and implementation within a Healthcare Provider organization. This position will involve working as...

  • Data Engineer

    2 weeks ago


    Hyderabad/Pune/Ahmedabad, IN Talentoj Full time

    Azure Data Engineer :We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required.The ideal candidate should have extensive experience in Python programming and be proficient in...

  • Lead SQL Developer

    2 weeks ago


    Bangalore/Mysore/Coimbatore, IN Aezion.Inc Full time

    Role : Lead- SQL DeveloperExperience : 7+ yearsSkills Required : T-SQL, MSSQL, SSISNotice period : 30 days or lessLocation : Bangalore/Mysore/Coimbatore (Work from office)Required experience : 7+Years Demonstrated proficiency with complex T-SQL queries, stored procedures, query tuning and optimization.5+Years hands-on experience in Design, Develop, Deploy...


  • Bangalore/Noida/Coimbatore, IN Worksconsultancy Full time

    About the client:- Company Name: Client - Industries: IT Services & Consulting - Company Type: Forbes Global 2000 - Funding Stage: Other - Headquarter Location: Bangalore - Nature of Offering: Product & Services - Founding Year: 2011 - No of Employees: 501-1000 Job Description :- Support the configuration of the Salesforce environment according to client...


  • Chennai/Madurai/Coimbatore, IN Optisol Business Solutions Full time

    Position : Data Engineer( Senior/Lead)Experience : 4-10 yrs.Locations : : Immediate -15 Days (Preferred)Required Candidate Profile :As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development &...

  • Data Analyst

    2 weeks ago


    Kerala/Telangana/Gujarat/Ahmedabad/Gandhinagar/Vadodara/Baroda/Surat/Nasik/Cochin/Kochi/Trivandrum/T, IN Aricent Full time

    Role : Data AnalystHiring Office : 3 Location WFOJob Description :Roles and Responsibilities :- Familiarity with leading data sourcing platforms and tools.- Ability to analyze data sets and extract valuable insights.- Meticulous attention to detail and unwavering commitment to high standards.- Proactive self-starter with the capability to work autonomously...

  • Senior Java Architect

    2 weeks ago


    Coimbatore/Bangalore/Tamil Nadu/Chennai, IN Virtual Tech Gurus India Private Limited Full time

    Job Description :Key Responsibilities :Lead the design and development of complex Java applications with a focus on AI and ML integration.Collaborate with cross-functional teams to identify opportunities for leveraging AI and ML to solve business challenges.Design and implement scalable and efficient AI models and algorithms.Stay abreast of emerging AI and...

  • IT Manager

    2 weeks ago


    Gujarat/Ahmedabad/Rajkot/Surat/Vadodara/Baroda/Guwahati/Srinagar/Jammu & Kashmir/Jammu/Hyderabad/Tel, IN Aricent Full time

    Role : IT Data Engineer - ManagerJob description :- The Data Engineer Manager role will be an integral part of an Agile team focused on delivering best in class business intelligence- Under the general supervision of senior management and the Data Integration Chapter Lead in the Enterprise Data Product Portfolio, you will be working with key customers to...

  • ODI Technical Lead

    2 weeks ago


    Bangalore/Mumbai/Pune/Chennai/Coimbatore/Hyderabad/Noida, IN Renovision Automation Services Pvt.Ltd. Full time

    Shift: 2 PM to 11 PMMode of Work: Hybrid Mandatory Skill combination: ODI Lead, Source Systems (flat files (csv and json), Oracle DB, etc.), Snowflake, Large DataJD:- Technical experience with the development of ETL processes in the Data Warehouse Oracle environment- Experience with Informatica Power Center, Power Exchange or Oracle ODI.- Expert in - SQL and...


  • Bangalore/Ahmedabad/Pune/Hyderabad/Chennai/Noida/Indore, IN eInfochips Full time

    Role : Firmware Validation Lead. Location : Ahmedabad, Pune, Bangalore, Hyderabad, Indore, Chennai, Noida. Company Overview : . eInfochips, an Arrow company, is a global leader in product engineering and semiconductor design services. Renowned for our technological innovations, we've developed over 500 products, achieving 40M deployments across 140...


  • Bangalore/Delhi NCR/Coimbatore, IN Worksconsultancy Full time

    Job Description :- Analyze real time and historic data on operational performance and customer experience- Generate and modify user dashboards; partner with development & testing teams to create effective tools- Coordinate with Salesforce administration & Development teams to take the ownership of technical delivery and escalate to relevant resources on...

  • Dotflick Solutions

    2 weeks ago


    Tamil Nadu/Chennai/Madurai/Coimbatore, IN Dotflick Solutions Full time

    Role : Senior Software Engineer - Embedded TestingJob description :- 4+ years of experience in Embedded Testing- Candidate should have good experience in testing of Web Application, REST APIs and embedded applications.- Hands-on experience in providing innovative solutions to Automate Web/Windows/iOS based applications.- Extensive experience with Test...

  • Dotflick Solutions

    2 weeks ago


    Bangalore/Bhubaneshwar/Tamil Nadu/Chennai/Madurai/Coimbatore, IN Dotflick Solutions Full time

    Role : Data Governance EngineerJob Description :- Participate in establishing data/database standards, defining best practices for data management, defining requirements for governance frameworks/policies such as Retention, PII handling, RBAC etc.- Conduct regular audits to ensure set standards are adhered to and ensure compliance to data governance...