Big Data Innovator
2 days ago
We are seeking a highly skilled Big Data Developer to join our team at Luxoft. As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies.
The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine learning and artificial intelligence, and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses.
Responsibilities- Develop high-quality, secure code that is modular, functional, and testable.
- Drive the evolution of Data & Services products/platforms with an impact-focused on data science and engineering.
- Design and implement scalable data architecture and data pipelines.
- Solve complex problems with multi-layered data sets, as well as optimize existing machine learning libraries and frameworks.
- Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers.
- Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.
- Discover, ingest, and incorporate new sources of real-time, streaming, batch, and API-based data into our platform.
- Participate in the development of data and analytic infrastructure for product development.
- Continuously innovate and determine new approaches, tools, techniques & technologies to solve business problems and generate business insights & recommendations.
- Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms.
- Good programming skills in Java and spring boot and Junit.
- Knowledge in software development test approaches & frameworks.
- Familiarity with RESTful APIs and micro-services architectures.
- Experience in working with CI/CD.
- Experience in working with SQL database like Postgres, Oracle.
- Preferably with hands-on experience with Hadoop big data tools (Hive, Impala, Spark).
- Experience with data pipeline and workflow management tools: NIFI, Airflow.
- Comfortable in developing shell scripts for automation.
- Good troubleshooting and debugging skills.
$120,000 - $180,000 per year
-
Big Data Solutions Architect
7 days ago
India ITI Data Full timeJob Title: Big Data Solutions Architect Company Overview:ITI Data is a leading provider of data solutions and services. About the Role:We are seeking an experienced Big Data Solutions Architect to join our team. The successful candidate will have a strong background in designing and implementing large-scale data architectures using Apache Spark, Hadoop, and...
-
Big Data Engineer for Innovative Team
4 weeks ago
India Coffeee Full timeWe are seeking an experienced Big Data Engineer to join our innovative team at Coffeee. As a key member of our team, you will be responsible for developing and implementing Hadoop-based solutions that drive business growth.The ideal candidate will have hands-on experience with the Hadoop ecosystem, including HDFS, Hive, Pig, and Spark. You will also be...
-
Big Data Architect
3 days ago
India Bloom Consulting Services Full timeNot Disclosed Experience **12 - 16 Years** Offered Salary **Lakh** Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end...
-
Big Data Architect
3 days ago
India Bloom Consulting Services Full timeNA Experience **12 - 16 years** Offered Salary Notice Period **Not Disclosed** **Role: Big Data Architect** **Location: Bangalore** **Skills required**: Total 12 to 16 years of experience in BI, analytics, visualization, **data** integration, designing and developing **data **warehouses (ETL, **data**bases, front-end tools). 9+ years of...
-
Big Data Innovator
4 weeks ago
India Zyoin Group Full timeAt Zyoin Group, we are seeking a highly skilled Data Engineer to join our team in creating cutting-edge data solutions. This role offers an opportunity to work with scalable data processing technologies and contribute significantly to backend development projects.Key Responsibilities:Design and develop efficient, secure, and testable code architectures for...
-
Big Data Developer
4 weeks ago
India Impetus Full timeLead Software Engineer Locations- Indore, Noida, Hyderabad Job Description We are looking for a Lead Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles & Responsibilities Key Responsibilities ...
-
Big Data Architect
8 months ago
India Princeton IT Services Full time**Job Title**: Big Data Architect **Location**:Kakinada (work from office) or Bangalore (work from office) **Shift**: UK shift preferred **Job Overview**: We are seeking a highly skilled and motivated Big Data Architect to join our team. This individual will play a crucial role in designing and implementing scalable and efficient big data solutions,...
-
Big Data Architect
3 months ago
India Persistent Systems Full time**About Persistent** We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what?s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with...
-
Big Data Architect
7 months ago
India Persistent Systems Full time**About Persistent** We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with...
-
Big Data Developer
4 weeks ago
India Luxoft Full timeProject Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...
-
Big Data Developer
4 weeks ago
India Luxoft Full timeProject Description: As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...
-
Big data developer
4 weeks ago
India IITMatrix Full timeWork location : Singapore Mandate skills: Java, microservices, big data, spring boot TEAM Architecture (Big Data) Experience with application development in Big Data Ecosystem (such as Cloudera, Elastic Search, Spark, Presto, Hive, Impala, Kibana, Logstash, Hbase, Kafka), Expertise in building applications using Scala, Java, Python, Shell...
-
Data Architect for Big Data Solutions
4 weeks ago
India Priceline Full timeUnlock Your Potential in a Fast-Paced Fintech EnvironmentWe are seeking an experienced Data Architect to join our Technology team, where you will play a key role in designing and implementing big data solutions that drive business growth.About the Role:Job Summary:This is a high-level position responsible for leading the design, development, and...
-
Big Data Engineer: Scalable Solutions Developer
4 weeks ago
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
Big Data Engineer
2 months ago
India Pert Telecom Solutions Full timeJob Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...
-
Big Data Developer
4 weeks ago
India Randstad Digital Full timeJob Title: Big Data DeveloperLocation: BangaloreExperience: 5+ YearsJob Description:We are seeking a highly skilled Big Data Developer to join our team at Randstad Digital. As a key member of our data engineering team, you will design, build, and configure applications to meet business process and application requirements.Key Responsibilities:Design, create,...
-
Big Data Analytics Expert
4 weeks ago
India LTIMindtree Full timeAre you looking for a challenging role in the field of Big Data?We at LTIMindtree are seeking experienced professionals with strong expertise in Spark/Pyspark/Scala Spark/Java Spark skills.About Our CompanyLTIMindtree is a leading global technology consulting and business solutions company that provides innovative, next-generation IT services to its clients...
-
Senior Big Data Engineering Specialist
7 days ago
India DigitalTek Solutions Full timeCompany OverviewDigitalTek Solutions is a trusted provider of managed services, staff augmentation, and IT consulting. With over a decade of expertise, we deliver tailored solutions to Fortune 1000 companies across North America.We specialize in connecting top talent with opportunities in the IT, Engineering, and Digital sectors, serving various industries...
-
Big Data Architect
2 days ago
India leading MNC Full timeJob Overview:We are seeking an experienced Big Data Architect to join our team at a leading MNC. As a key member of our data engineering team, you will design and implement scalable and efficient data processing systems using cloud-native technologies.Responsibilities:Design and develop distributed data lake query engines with high scalability and low...
-
Big Data Developer
3 weeks ago
India Populace World Solution Full timePosition: Big Data DeveloperLocation: Chennai, Pune, Bangalore, Mumbai and Gurugram experience: 5+ yearsKey ResponsibilitiesUnderstanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic SearchExperience with job scheduling and debugging in production environment.Experience with coding with one of...