Big Data Developer
4 weeks ago
We are looking for a Big Data Engineer with a mindset to solve complex analytics problem and the ability to use the latest tools and technology and build solutions that are reliable and scalable to work with the size and scope of the company, then we would like to connect with you.
Roles & Responsibilities:
- Participate in design and implementation of the analytics architecture.
- You will work Spark/Scala, DevOps tools like Kubernetes, Docker as part of the Data Engineering role
- Manage Aspects of Data Life Cycle from Ingestion to Visualization
- Be Involved in Databases (SQL and NoSQL)
- Do Real-time streaming distributed data processing.
- Identify, analyse trends or patterns in complex data set
- Work closely with analysts and business process owners to translate business requirements into technical solutions.
- Transform Data in required format as defined in process.
- Improve and adapt new technique and solutions to adapt data at scale.
- Be part of design which will scale to adapt Petabyte of data
- Formulate strategy to map business requirement to visualization layer.
Minimum Requirements:
- Strong Big Data experience with Enterprise Data warehousing hands-on experience
- At least 4+ Years of Hands-on experience in Apache Spark/Scala is Mandatory.
- Strong experience on SQL and NoSQL Databases: PostgreSQL, MySQL, MongoDB, Elasticsearch, Hive, Cassandra, Redis
- Experience with Agile & DevOps methodologies
- Good working knowledge with source control system Git, any of Gitlab/Github/AzureRepos
- Familiarity with one or more SQL-on-Hadoop technology (Hive, Spark SQL, Presto).
- Real-time streaming distributed data processing using Apache Flink, Kafka, or Spark Streaming will be added advantage.
- Good to know about Apache Airflow, Apache Nifi.
- Experience monitoring, troubleshooting, and tuning services and applications and operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks.
-
Big Data Developer
3 weeks ago
Navi Mumbai, Maharashtra, India Reliance Industries Limited Full timeWe are seeking a highly skilled Big Data Developer to join our team at Reliance Industries Limited. The ideal candidate will have a strong background in data engineering and analytics, with experience in designing and implementing data architectures that meet the needs of large-scale enterprise environments.Key Responsibilities:Collaborate with...
-
Big Data Engineer
1 week ago
navi mumbai, India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Engineer
1 week ago
Navi Mumbai, India Pert Telecom Solutions Full timeJob Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...
-
Big Data Developer
3 weeks ago
Mumbai, Maharashtra, India Pegasus InfoCorp Full timeAbout the Role:Pegasus InfoCorp is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for building solutions for customers using Big Data technologies. You will work on designing, developing, and implementing Big Data solutions that meet our customers' needs. You will also be responsible for...
-
Big Data Developer
3 weeks ago
Mumbai, Maharashtra, India Tata Consultancy Services Full timeJob Role: Big Data DeveloperWe are looking for a qualified Big Data Developer to join our team at Tata Consultancy Services.Responsibilities:Ingest data from diverse sources and develop ETL jobs using Spark, PySpark, Hive, and HBase.Perform impact analysis and provide estimates.Oversee end-to-end deliverables.Create project plans and work on implementation...
-
Big Data Developer
1 month ago
Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full timeAbout the Role:We are seeking a skilled Big Data Developer to join our team at Synechron Technologies Pvt. Ltd. The ideal candidate will have proficiency in one or more general-purpose big data languages, including Hive and Spark.Key Responsibilities:Design and develop big data solutions using Hive, Java, or SparkWork with UNIX, SQL Server, and JavaDevelop...
-
Big Data Developer
3 months ago
Mumbai, India krtrimaIQ Cognitive Solutions Full timekrtrimaIQ having deep expertise in Technology domains Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing and Computer Vision, is well prepared to transform organizations to Intelligent Enterprise.The RoleDesign, develop, and maintain scalable data processing pipelines using Kafka,...
-
Big Data Developer
3 months ago
Mumbai, India Snaphunt Full timeThe OfferWork within a company with a solid track record of successExcellent career development opportunitiesGreat work environmentThe JobDesign, develop, and maintain scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Work extensively with the Kafka and Hadoop ecosystem, including HDFS, Hive, and other related...
-
Big data developer
3 weeks ago
Mumbai, India Tata Consultancy Services Full timeRole- Big DataLocation- Mumbai, Pune, ChennaiExperience- 5 to 10 YrsMust Have - Spark, Pyspark, Hive, HbaseResponsibility of / Expectations from the Role1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills.2 Do impact analysis and come up with estimates3 Take responsibility for...
-
Senior Software Developer
1 month ago
Navi Mumbai, Maharashtra, India Sciative Solutions Full timeJob Title: Senior Software Developer - Artificial Intelligence and Big DataSciative Solutions is on a mission to revolutionize the future of dynamic pricing powered by artificial intelligence and big data. Our Software-as-a-Service products are used globally across various industries - retail, ecommerce, travel, and entertainment. We are a fast...
-
Big Data Developer
4 weeks ago
mumbai, India Tata Consultancy Services Full timeRole- Big Data Location- Mumbai, Pune, Chennai Experience- 5 to 10 Yrs Must Have - Spark, Pyspark, Hive, Hbase Responsibility of / Expectations from the Role 1 Ingest data from disparate sources (Structured, unstructured and semi-structured) and develop ETL jobs using the above skills. 2 Do impact analysis and come up with estimates 3 Take...
-
Data Engineer for Cloud and Big Data Ecosystem
2 weeks ago
Navi Mumbai, Maharashtra, India Jio Full timeAt Jio, we are seeking a skilled Data Engineer to join our team in the OTT Media Operations department.We are looking for an experienced professional with a strong background in Application Operations support, particularly in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, Storm, Flink, Kafka). The ideal candidate will have hands-on experience...
-
Expert Big Data Developer
4 weeks ago
Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full timeWe are seeking a highly skilled Expert Big Data Developer to join our team at Synechron Technologies Pvt. Ltd. in Mumbai, Goregaon. About the Role:Proficiency in one or more general purpose big data languages – Hive and Spark7 years+ experience in designing and development using Hive, Java or Spark. 2+ years experience working in UNIX, SQL Server, Java 3...
-
Big Data Support Engineer
4 weeks ago
Navi Mumbai, Maharashtra, India Jio Full timeAbout the Role: We are seeking a highly skilled Senior Hadoop Operations Engineer to join our team at Jio, where you will play a key role in ensuring the smooth operation of our big data infrastructure.Key Responsibilities:Big Data Infrastructure Management: You will be responsible for managing and maintaining our Hadoop cluster, including configuring and...
-
Big Data Engineer
3 weeks ago
Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full timeKey Responsibilities:As a Data Processing Expert at Smartavya Analytica Private Limited, you will be responsible for developing, testing, and implementing Big Data projects using Hadoop, Spark, and Hive. Your expertise in setting up Hadoop services, implementing ETL/ELT pipelines, and working with Terabytes of data ingestion and processing from varied...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India Synechron Technologies Pvt. Ltd. Full timeAbout SynechronSynechron is a global consulting firm that specializes in digital transformation and innovation. Our team of experts combines creativity and technology to deliver industry-leading digital solutions.Job RoleThe Hadoop Developer will work on designing and developing big data solutions using Hive, Java, and Spark. The ideal candidate should have...
-
Big Data QA
3 weeks ago
Mumbai, India Brainhunter Recruiting Pvt Ltd Full timeJob Title: Big Data QA Engineer We are seeking a highly skilled and motivated Big Data QA Engineer with expertise in automation testing using Java or Python programming languages. The ideal candidate should possess a strong background in data validation, data verification, PySpark, pipeline monitoring, software...
-
Big Data Architect
3 weeks ago
Mumbai, Maharashtra, India Vertoz Full timeJob OverviewWe are seeking a skilled Data Engineer with Hadoop Experience to join our team at Vertoz. The ideal candidate will be responsible for designing, developing, and maintaining our data pipeline architecture, ensuring seamless data flow and collection for cross-functional teams.The selected candidate will have hands-on experience with Hadoop, Spark,...
-
Big Data Engineer
1 month ago
Mumbai, Maharashtra, India Smartavya Analytica Private Limited Full timeJob DescriptionSmartavya Analytica Private Limited is seeking a highly skilled Hadoop Developer to join our team.Key ResponsibilitiesDesign and implement large-scale Big Data projects using Hadoop, Spark, and Hive.Lead the development of ETL/ELT pipelines and data ingestion processes.Collaborate with cross-functional teams to deliver high-quality data...
-
Big Data Developer
3 weeks ago
Mumbai, India Impetus Full timeF2F Hiring Drive on 16th Nov in Pune.Location: Impetus Technologies India Pvt. Ltd3rd Floor, We Work, Raheja WoodsKalyani Nagar, Pune – 411006 (Maharashtra)Exp: 3.5-6yrsExperience with design and coding across one or more platforms and languages (e.g. , Python/Pyspark/SQL, Scala) as appropriateHands-on expertise with application design, software...