We are looking for Data Engineer to join our hedge fund and manage our data operations. You will be responsible for engaging with various data vendors, designing and implementing data pipelines, and ensuring data quality and security. You will also support the data infrastructure and pipelines of the fund.
Responsibilities:
- Engage with various data vendors to find the best data for the fund’s investment and trading activities
- Evaluate data quality, delivery timing, frequency, method, and symbology of different data sources
- Follow up contract and budget approval process with data vendors and internal stakeholders
- Keep records of cost splits and propose ratio drafts for data vendor invoices
- Design data pipelines to process various internal and external data according to the nature of the data and the need of internal users
- Make sure the data pipeline and storage solutions are performant and scalable
- Implement automated data quality checks and alert system to monitor and troubleshoot data issues
- Provide adequate access control and usage audit solutions to ensure data security and compliance
- Research and evaluate latest data related technologies and tools to keep our data platform updated and competitive
- Lead and mentor a team of data engineers and ensure they have the necessary skills, tools, and resources to perform their tasks
- Collaborate with the investment and trading teams to understand their data needs and provide them with relevant and timely data access and delivery
Requirements:
- Bachelor’s degree in computer science, electronic engineering or similar engineering background
- At least 2 years of experience in data engineering, preferably in the hedge fund industry or a related field
- Curiosity about the finance industry and the ability to handle the data correctly based on the understanding of how users use it
- Able to code in at least one static language, such as Java, C# etc.
- Familiar with PostgreSQL and experienced with best practices and performance tuning
- Familiar with Apache data tool stack, such as Airflow, Spark, Kafka, etc.
- Experience with vendor management, price negotiation, and contract review is a plus
- Familiar with KDB and other specialized database is a plus
- Experience with storage cost optimization and data center hardware for high availability data storage is a plus
- Excellent communication, presentation, and interpersonal skills
- A keen interest and understanding of the financial markets and hedge fund strategies