Big Data Engineer

4 weeks ago

GoaMumbaiJammu ampamp KashmirJammuSrinagarPondicherryJaipurLucknowVaranasiBanarasPatnaRanchi, India ATech Full time

Designation: BIG DATA ENGINEER

Job Description:

Your Role and Responsibilities:

- Understand a data warehousing solution and able to work independently in such an environment

- Responsible in Project development and delivery experience of a few good size projects

- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.

- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.

- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

- Experiencing developing scalable Big Data applications or solutions on distributed platforms

- Able to partner with others in solving complex problems by taking a broad perspective to identify innovative solutions

- Strong skills building positive relationships across Product and Engineering.

- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders

- Able to quickly pick up new programming languages, technologies, and frameworks

- Experience working in Agile and Scrum development process

- Experience working in a fast-paced, results-oriented environment

- Experience in Amazon Web Services (AWS) or other cloud platform tools

- Experience working with Data warehousing tools, including Dynamo DB, SQL, Amazon Redshift, and Snowflake

- Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform.

- Experience working with Data platforms, including EMR, Data Bricks etc

- Experience working with distributed technology tools, including Spark, Presto, Scala, Python, Databricks, Airflow

- Developed the Pysprk code for AWS Glue jobs and for EMR.. Worked on scalable distributed data system using Hadoop ecosystem in AWS EMR, MapR distribution..

- Developed Python and pyspark programs for data analysis.. Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).

- Developed Hadoop streaming Jobs using python for integrating python API supported applications..

- Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..

- Re - write some Hive queries to Spark SQL to reduce the overall batch time

Required Technical and Professional Expertise:

- First and most important- Sound understanding of data structures & SQL concepts and experience in writing complex SQL especially around OLAP systems

- Sound knowledge of the ETL tool like informatica, 5+ years of experience, Big Data technologies'' like Hadoop ecosystem, its various components, along with different tools including Spark, Hive, Sqoop,etc..

- In-depth knowledge of MPP/distributed systems

Preferred Technical and Professional Expertise:

- The ability to write precise, scalable, and high-performance code

- The ability to write precise, scalable, and high-performance code

- Knowledge/Exposure in data modeling with OLAP (Optional)

(ref:hirist.tech)

  • Big Data Engineer

    2 weeks ago

    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • Big Data Engineer

    3 weeks ago

    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, IN ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • IT Manager

    4 weeks ago

    Gujarat,Ahmedabad,Rajkot,Surat,Vadodara,Baroda,Guwahati,Srinagar,Jammu & Kashmir,Jammu,Hyderabad,Tel, India Aricent Full time

    Role : IT Data Engineer - ManagerJob description :- The Data Engineer Manager role will be an integral part of an Agile team focused on delivering best in class business intelligence- Under the general supervision of senior management and the Data Integration Chapter Lead in the Enterprise Data Product Portfolio, you will be working with key customers to...

  • Big Data Engineer

    4 days ago

    Mumbai, India Feufo Inc Full time

    Job Title:Big DataEngineerExperienceRequired:3 yearspostcollege Location :Remote ( MUST be comfortable with working in Eastern Time (USA)) Budget :USD permonthPositionOverview: We are seeking adynamic and versatile Big Data Engineer to drive the efficiency ofour Data Scientists and Engineering team. The successful candidatewill play a pivotal role in...

  • Big Data Engineer

    2 weeks ago

    Mumbai, India Feufo Inc Full time

    Job Title: Big DataEngineerExperienceRequired: 3 yearspostcollegeLocation:Remote ( MUST be comfortable with working in Eastern Time (USA))Budget:USD permonthPositionOverview:We are seeking adynamic and versatile Big Data Engineer to drive the efficiency ofour Data Scientists and Engineering team. The successful candidatewill play a pivotal role in...

  • Big Data Engineer

    6 days ago

    mumbai, India Feufo Inc Full time

    Job Title: Big DataEngineer ExperienceRequired: 3 yearspostcollegeLocation :Remote ( MUST be comfortable with working in Eastern Time (USA))Budget :USD permonthPositionOverview: We are seeking adynamic and versatile Big Data Engineer to drive the efficiency ofour Data Scientists and Engineering team. The successful candidatewill play a pivotal role in...

  • Big data Full-Time

    3 weeks ago

    Jaipur, India HyreFox Consultants Full time

    POSITION: Big Data EngineerUST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization.Primary skills:Apache Hadoop, Apache Spark, Apache KafkaRoles &...

  • Data Science Trainer

    4 days ago

    Jammu, India Winnovation Education Services Pvt. Ltd. Full time

    **JD for DataScience Trainer** **Position Overview**: We are seeking a highly skilled and knowledgeable data scientist to join our team. As a Data Science Trainer, you will work closely with our Students & Partner College Authorities, You will provide expert guidance and support in implementing Live industry projects. **Key Responsibilities**: - Perform...

  • Big data Full-Time

    4 weeks ago

    jaipur, India HyreFox Consultants Full time

    POSITION: Big Data Engineer UST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization. Primary skills:  Apache Hadoop, Apache Spark, Apache...

  • Big Data Engineer

    3 weeks ago

    Jaipur, India ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • PLC Technician

    4 weeks ago

    Jammu, India Larsen & Toubro Full time

    Designing, maintaining, implementing, or improving electrical instruments, facilities, components, equipment products, or systems for industrial, commercial, or domestic purposes. Performing a wide range of engineering tasks by operating computer-assisted design or engineering software and equipment. Conferring with customers, engineers, and others to...

  • Electrical Engineer- P&M

    2 days ago

    Jammu, India Larsen & Toubro Full time

    Candidate should have experience/ knowledge in,Designing, maintaining, implementing, or improving electrical instruments, facilities, components, equipment products, or systems for industrial, commercial, or domestic purposes.Repair and maintenance of all the electrical plant and parts.Experience in daily maintenance of all electrical aspects related to...

  • Lead Full Stack Developer

    4 weeks ago

    Andhra Pradesh,Vijayawada,Vishakhapatnam,Vizag,Jammu & Kashmir,Jammu,Srinagar, India ATS India Full time

    Role : Lead Full Stack DeveloperIndustry Type : IT Services Department : Engineering Employment Type : Full Time, PermanentJob description :- Work with distributed development teams and product managers to ideate software solutions.- Developing front end website architecture.- Designing user interactions on web pages.- Developing back-end website...

  • Electrical Engineer- P&M

    1 week ago

    jammu, India Larsen & Toubro Full time

    Candidate should have experience/ knowledge in, Designing, maintaining, implementing, or improving electrical instruments, facilities, components, equipment products, or systems for industrial, commercial, or domestic purposes. Repair and maintenance of all the electrical plant and parts. Experience in daily maintenance of all electrical aspects...

  • Electrical Engineer- P&M

    4 weeks ago

    Jammu, India Larsen & Toubro Full time

    Candidate should have experience/ knowledge in, Designing, maintaining, implementing, or improving electrical instruments, facilities, components, equipment products, or systems for industrial, commercial, or domestic purposes. Repair and maintenance of all the electrical plant and parts. Experience in daily maintenance of all electrical aspects related...

  • Architect : Big Data

    4 days ago

    Mumbai, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Grouting Engineer

    2 days ago

    Jammu, India Larsen & Toubro Full time

    The following Job Description pertains to a grouting Engineer1. Coordinate all grouting, ground treatment, and related activities for tunnels as per technical requirements.2. Monitoring and observation of drilling and grouting parameters during drilling, Lugeon test, and grouting for Curtain and consolidation grouting (Curtain grouting: a row of vertically...

  • Grouting Engineer

    1 week ago

    jammu, India Larsen & Toubro Full time

    The following Job Description pertains to a grouting Engineer 1. Coordinate all grouting, ground treatment, and related activities for tunnels as per technical requirements. 2. Monitoring and observation of drilling and grouting parameters during drilling, Lugeon test, and grouting for Curtain and consolidation grouting (Curtain grouting: a row of...

  • Grouting Engineer

    1 month ago

    Jammu, India Larsen & Toubro Full time

    The following Job Description pertains to a grouting Engineer 1. Coordinate all grouting, ground treatment, and related activities for tunnels as per technical requirements. 2. Monitoring and observation of drilling and grouting parameters during drilling, Lugeon test, and grouting for Curtain and consolidation grouting (Curtain grouting: a row of...

  • Architect : Big Data

    7 days ago

    mumbai, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...