Senior Data Engineer

### Join 3Pillar as a Senior Data Engineer! Embark on an exciting journey into the realm of software development with 3Pillar! We focus on leveraging cutting-edge technologies that revolutionize industries by enabling data-driven decision-making. As a Senior Data Engineer, you will play a crucial role in our dynamic team, contributing to projects that reshape data analytics for our clients, providing them with a competitive advantage. #### Key Responsibilities: - Understand business requirements and write code to implement proposed solutions. - Create and manage data pipelines, including versioning and change management. - Develop ETL/ELT processes to extract and manipulate data from multiple sources. - Design, build, and maintain batch or real-time data pipelines in production. - Automate data workflows such as data ingestion, aggregation, and ETL processing. - Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. - Train and mentor junior engineers. #### Minimum Qualifications: - 5+ years of experience as a Data Engineer or similar role. - Advanced SQL skills and experience with relational databases and database design. - Experience with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse). - Strong Python skills with hands-on experience on Pandas, NumPy, and other data-related libraries. - Familiarity with Big Data technologies like Spark, Hadoop, and Hive. - Proficient in data pipeline and workflow management tools (e.g., Airflow). - Experience with data visualization tools (e.g., PowerBI, Tableau). - Knowledge of AWS/Azure/GCP data engineering services. #### Benefits: - Medical and Life Insurance benefits as per company policy. - 15 days of paid vacation plus additional days based on tenure.