Big Data Engineer
2 weeks ago
Job Description :
- At least 4+ years of experience pyspark framework.
- Good experience writing complex SQL and No SQL databases.
- Excellent coding and design skills, particularly in Pyspark and Python.
- Strong practical working experience with Unix scripting in at least one of Python, HDFS, SQL, PL/SQL, Shell (either bash or zsh).
- Experience in AWS technologies such as EC2, Redshift, Cloud formation, EMR, AWS S3, AWS.
- Experience designing and implementing data pipelines in a onprem/cloud environment is required.
- Experience building/implementing data pipelines using Databricks/On prem or similar cloud database.
- Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
- Hands-on object-oriented programming experience using Python is required.
- Professional work experience building real-time data streams using Spark and Experience in Spark.
- AWS certification is preferable: AWS Developer/Architect/DevOps/Big Data
-
Big Data Engineer
3 weeks ago
Bangalore/Chennai/Pune, IN ADVANSOFT Full timeWe are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...
-
Senior Big Data Engineer
3 weeks ago
Bangalore/Pune, IN Recrud Full timeSenior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...
-
Data Engineer
3 weeks ago
Bangalore/Pune, IN Pylon Management Consulting Full timeRequirements:- Overall 5+ years of IT experience with 3+ years in data-related technologies.- Minimum 2.5 years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP).- Hands-on experience with the Hadoop stack - HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink,...
-
Big Data Engineer
3 weeks ago
Bangalore/Chennai/Pune/Noida/Cochin/Kochi/Trivandrum/Thiruvananthapuram/Hyderabad, IN SPG Consulting Solutions Pvt.Ltd Full timeLocation : Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum.Job Description :- Proficient in SQL, Spark, Scala, and AWS, with a strong command over these technologies.- Minimum 6-7 years of relevant experience in Spark and SQL, plus 2-3 years of hands-on practice in AWS.- Demonstrated track record of effectively optimizing performance.- Adept at leveraging...
-
Senior Data Engineer
3 weeks ago
Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...
-
Big Data Quality Assurance Engineer
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full timeWe are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...
-
Big Data Developer
3 weeks ago
Gurgaon/Gurugram/Bangalore, IN Workassist.in Full timeOur hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...
-
Big Data Engineer
3 weeks ago
Any Location/Bangalore, IN Careerfit.ai Full timeResponsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...
-
Any Location/Bangalore/Chennai, IN Digihelic Solutions Pvt. Ltd. Full timeJob Summary :We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our data-driven initiatives, leveraging AWS services...
-
Big Data Engineer
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full timeKey Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...
-
Valiance Solutions
3 weeks ago
Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full timeAbout Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...
-
AWS Data Architect
3 weeks ago
Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full timeRole Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...
-
Spark Engineer
3 weeks ago
Bangalore/Onsite In Bangalore, IN Cyber Sphere LLC Full timeJob Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...
-
Data Engineer
2 weeks ago
Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full timeRole : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...
-
Big Data Architect
3 weeks ago
Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full timeAbout the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...
-
Big Data Engineer
3 weeks ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Senior Java Big Data Engineer
3 weeks ago
Bangalore/Delhi, IN SavvyR Solutions Private Limited Full timeYour primary focus will be writing clean, maintainable, and efficient Java code to extract, transform, and load massive datasets. You will also collaborate closely with data scientists, analysts, and other engineers to ensure our solutions meet business needs and deliver real value.Responsibilities :Design, develop, test, and deploy robust, scalable Java...
-
Senior Data Engineer
3 weeks ago
Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full timeSenior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...
-
Data Engineer
3 weeks ago
Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full timeBasic understanding of :- Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar- Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar- Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio,...
-
Big Data Engineer
3 weeks ago
Hyderabad/Bangalore/Indore, IN Nucleusteq Full timeJob Description :Role Requirements :- Profound programming language experience in Java/Scala and Python.- Knowledge of Hadoop ecosystem and strong hands-on experience on Hive and Spark.- Understanding on Modernisation, Informatica migration- Must have understanding on messaging services and their integrations.- Good to have experience in streaming...