Data Flow Engineer

7 days ago

Greater Noida, Uttar Pradesh, India Clearwater Analytics Full time US$ 80,000 - US$ 1,20,000 per year

Job Summary: 

The Data Flow Engineer's primary role is to create and manage data connections, perform validations, and execute transformations. Their work is integral to the ongoing process of iterative improvement, with a particular focus on enhancing auto-reconciliation within the system through advanced technology. 

Responsibilities: 

  • Import and validate file delivery for new clients. 

  • Automate daily process monitoring and reporting. 

  • Establish connections through external APIs and FTPs. 

  • Ensure timely and dependable consumption of external portfolio data. 

  • Normalize external datasets into a standardized Clearwater format facilitating the in-take process. 

  • Mine data from existing feeds to identify, design, and implement solutions to improve auto-reconciliation. 

  • Execute improvements requested from Operations and Development groups. 

  • Apply acquired skills, procedures, and decision-making best practices to complete various issues, such as normalizing new feeds and improving automation. 

  • Understand and reference or explain the general workflow, tools, and Clearwater value proposition. 

  • Use critical thinking to address issues and offer solutions for both internal and external parties, ensuring best practices are employed. 

  • Clearly and effectively communicate the technical aspects of Clearwater systems and our best practices with non-technical internal and external stakeholders. 

  • Engage in light on-call duties. 

Required Skills: 

  • Securities, accounting, and financial experience. 

  • Strong understanding of SQL and relational database principles. 

  • Experience with scripting programming languages like Groovy, Perl or Python. 

  • Experience with industry-standard data transmission protocols preferred. 

  • Securities, accounting, and financial experience preferred. 

  • Strong computer skills, including proficiency in Microsoft Office.  

  • Excellent attention to detail and strong documentation skills.  

  • Outstanding verbal and written communication skills.  

  • Strong organizational and interpersonal skills. 

  • Exceptional problem-solving abilities. 

Education and Experience: 

  • Bachelor's degree in Math, Computer Information Systems, or other relevant degrees. 

  • 2+ years of relevant experience. 

  • Experience with industry-standard data transmission protocols. 

  • Data Flow Engineer

    3 hours ago

    Noida, Uttar Pradesh, India Clearwater Analytics Full time US$ 80,000 - US$ 1,20,000 per year

    Job Summary: The Data Flow Engineer's primary role is to create and manage data connections, perform validations, and execute transformations. Their work is integral to the ongoing process of iterative improvement, with a particular focus on enhancing auto-reconciliation within the system through advanced technology. Responsibilities: Import and validate...

  • Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Data Engineer

    1 day ago

    Noida, Uttar Pradesh, India HCLTech Full time

    Role: Data Engineer Total years of experience: 9+ Years Location: PAN India (Any HCL office) Relevant experience for engagement: 5 Years Note: - We are conducting a virtual discussion on this coming Saturday, 13th of Sep 25 from 9:30 am to 6:30 pm, if interested please feel free to share your profiles Job Description: Relevant Skills: Maintain...

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Data Engineer - Data Ingestion Pipeline SpecialistAs a key member of our team, you will be responsible for designing and developing robust data ingestion pipelines using Apache NiFi for structured, semi-structured, and unstructured data sources. You will also build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes...

  • Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Data Engineering ProfessionalAbout the RoleThis role involves designing and developing data ingestion pipelines using Apache NiFi for structured, semi-structured, and unstructured data sources.The ideal candidate will build and maintain real-time and batch processing workflows to ingest data into AWS-based data lakes or warehouses.Key...

  • Data Engineering

    3 days ago

    Greater Noida, Uttar Pradesh, India Etelligens Technologies Pvt. Ltd. Full time US$ 1,00,000 - US$ 1,50,000 per year

    We are looking for a Data Engineering Lead with deep expertise in AWS, Python, and modern data engineering practices to architect and deliver scalable, secure, and efficient data solutions. In this role, you'll lead the design and development of ETL pipelines, implement robust data warehousing solutions, and support machine learning workflows across various...

  • Big Data Engineer

    4 days ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Big Data EngineeringAt the forefront of big data processing lies a complex web of systems, tools and workflows. To engineer such processes requires expertise in multiple areas, including data flow platforms, workflow management and large dataset integration.Our ideal candidate will possess hands-on experience with Apache Spark, utilizing Scala for...

  • Associate/Sr. Associate Operations

    5 hours ago

    Noida, Uttar Pradesh, India Data flow Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Communication & Coordination: Quality Assurance: Research & Analysis: Process Improvement: Perks and benefitscab shuttle , insurance

  • Data Engineer

    3 days ago

    Greater Noida, Uttar Pradesh, India Etelligens Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Responsibilities:5+ years of hands-on experience in data engineering, particularly with Python, PySpark, and SQL.Proven experience building ETL pipelines using AWS services (Glue, Lambda, S3, Athena, Step Functions).Strong knowledge of Data Warehousing concepts, SCD Types (Type 1, Type 2), and Medallion Architecture.Solid understanding of data modeling,...

  • Data Engineer

    3 days ago

    Noida, Uttar Pradesh, India R Systems Full time US$ 1,25,000 - US$ 1,75,000 per year

    Your Role and ImpactWe are looking for a skilledAWS Data Engineerwith hands-on experience in building and managing scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise inPython,SQL,Apache Spark, andAWS servicessuch asS3,Glue, and other cloud-native tools. You will be responsible for designing, developing, and...