Essential Functions
Design build and implement scalable data pipelines to ingest, process, and store large volumes of data from various sources.
Design, develop, and deploy Generative AI models for various applications, such as natural language processing (NLP) and other creative tasks.
Develop and maintain ETL (Extract, Transform, Load) processes to ensure data quality and integrity.
Responsible for Production development & Support (DevOPS) on payment system services handling Real time data.
Optimize data storage solutions, including databases, data lakes, and cloud-based storage systems.
Collaborate with data scientists and analysts to understand data requirements and provide the necessary infrastructure and tools.
Monitor and troubleshoot data pipelines to ensure reliability and performance.
Implement data governance and security measures to protect sensitive information.
Write and maintain comprehensive documentation for data workflows, architecture, and processes.
Stay updated on the latest trends and technologies in data engineering and recommend improvements to existing systems.
Participate in code reviews, provide constructive feedback, and contribute to a collaborative team environment.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.