Big Data Engineer
2 months ago
Role : Big Data Engineer
Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.
Associate should be self-driven, can work with minimal guidance and guide the team technically.
Job Details :
1. Expertise in Spark framework with scala language and Pyspark
2. Expertise in ETL and Data Warehousing and cloud concepts
3. Good work experience in SQL in hive and impala
4. Basic understanding in Spark, Hive and Impala architecture along with cloud integration concepts
5. Knowledge in shell scripting and git commands
6. Able to design and create data flows diagrams and do data modelling.
7. Expertise in data profiling and decision making.
8. Able to understand the Architecture and design end-to-end data flow.
9. Excellent- logical and analytical, troubleshooting, and problem-solving skills.
10. Excellent working knowledge of version control system like GitHub and branching strategies.
11. Able to understand and implement the spark optimization techniques and implement the same in the code.'
12. Communicate effectively and concisely with multiple stakeholders.
13. To monitor and support the year end activities, if needed
14. Ability to co-ordinate and collaborate with cross functional teams.
15. Well versed with security and compliance aspects in Cloud.
16. Good to have Big data related certifications and health care domain knowledge
-
Big Data Engineer
2 months ago
Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full timeJob Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...
-
Big Data Developer
2 months ago
Gurgaon/Gurugram, IN PRONTO CONSULTING SERVICES Full timeClient : LTI Mindtree Hybrid.Type : Fulltime Employment. Location : Gurgaon Only.NP : Serving the NP and can join within 60 days Only. Job Description : Skills : Big Data : Spark, Hive, Python, SQL. Location : Gurgaon Key Responsibilities : - Responsible for designing Data Engineering solutions on bigdata ecosystem developing custom applications and...
-
Big Data Developer
1 month ago
Gurgaon/Gurugram, IN Spectral Consultants – Search & Recruitment firm Full timeSALARY : Description :We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or ScalaKey Responsibilities : - Develop and maintain...
-
Big Data Engineer
2 months ago
Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full timeJob Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...
-
Data Strategist
2 months ago
Gurgaon/Gurugram, IN PrimeJobs Management Consultants Pvt Ltd Full timeWe're looking for a talented Data Strategist to join our EdTech client's UK team.Job Description :Key Responsibilities :- Lead data architecture and ensure seamless integration across platforms.- Develop and execute data strategies aligned with business objectives.- Collaborate with cross-functional teams to establish data governance and security.-...
-
NITS Solutions
2 months ago
Gurgaon/Gurugram, IN NITS Solutions Full timePosition Overview :We are looking for an Associate Big Data Engineer with hands-on experience on Python, SQL,POSTGRESQL with Basic understanding of Pandas, Pyspark and ETL process. The individual will be responsible to create solutions suitable for the job in a real-time, highly data-driven organization and make technical innovations happen.Job...
-
Data Engineer
2 months ago
Gurgaon/Gurugram, IN Paddlelift Full timeJob Description :You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...
-
Big Data Engineer
2 months ago
Chennai/Pune, IN Pan Asia Man power Consultants Recruiting agency Full timeJob Title : Big Data EngineerExperience Range : 6+ YearsLocation : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)Job Description :We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with...
-
Senior Big Data Engineer
4 weeks ago
Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full timePosition - Senior Big Data Engineer (GCP)Experience - 5 to 8 YrsLocation - RemoteShift - EST Shift 5:30 PM to 2:30 AMWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be...
-
Big Data Administrator
1 month ago
Bangalore/Gurgaon/Gurugram/Nagpur, IN Intuitive Apps Full timeAs a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...
-
Big Data Developer
2 months ago
Hyderabad/Bangalore/Chennai/Bhubaneshwar, IN Rigel networks Full timeJob Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...
-
Big Data Developer
2 months ago
Pune/Gurgaon/Gurugram, IN Talent Toppers LLP Full timeResponsibilities :- Undertake complete ownership in accomplishing activities and assigned responsibilities across all phases of project lifecycle to solve business problems across one or more client engagements;- Apply appropriate development methodologies (e.g.: agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA...
-
Big Data Engineer
6 months ago
Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, IN ATech Full timeDesignation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...
-
Decision Point
4 weeks ago
Gurgaon/Gurugram/Chennai/Bangalore, IN Decision Point Full timeWhat would a typical day at your work be like :- You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies. -...
-
Azimuth GRC
2 months ago
Gurgaon/Gurugram, IN AzimuthGRC Technologies India Private Limited Full timeJob Description :- Conceptualize and communicate Data architecture strategy, technical design and technology roadmap for data platform solutions and services.- Lead design and development of data architecture to support implementation of large-scale data solutions in Databricks to support multiple use cases (delta lake, cloud Datawarehouse migrations,...
-
Senior Data Engineer
2 months ago
Gurgaon/Gurugram/Noida, IN Om Careers Full timeExperience - 4+yrsSkill Set - Python, SQL, GCP, ETL (All mandatory)Location - Delhi/NCRRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution processes- The person will be part of...
-
Hadoop Administrator
5 months ago
Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full timeJob Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...
-
BluePi - Vice President - Data Engineering
2 months ago
Gurgaon/Gurugram, IN Bluepi Consulting private limited Full timeAbout BluePi :BluePi Consulting partners with organizations to help them achieve higher levels of maturity. Founded in 2012, has today grown to serve several established organizations across India & Australia. Self-funded, the organization has its sales offices in Mumbai & Sydney, besides its headquarters in Gurgaon. For over a decade, BluePi has helped...
-
ZS - Engineering Lead - Big Data
2 months ago
Pune/Gurgaon/Gurugram/Bangalore, IN ZS Full timeComapany Description :ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you'll work side-by-side with a powerful collective of thinkers and experts shZS is a place where passion changes lives. As a management...
-
Data Engineer
4 weeks ago
Noida/Bangalore/Chennai/Hyderabad/Coimbatore, IN Huntsmen & Barons Full timeRole : Data Engineer - Apache spark/Spark/Scala/pysparkJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark,...