# Dinky **Repository Path**: delete_h/Dinky ## Basic Information - **Project Name**: Dinky - **Description**: Dinky 是一个开箱即用的一站式实时计算平台，以 Apache Flink 为基础，连接 OLAP 和数据湖等众多框架，致力于流批一体和湖仓一体的建设与实践。 - **Primary Language**: Java - **License**: Apache-2.0 - **Default Branch**: dev - **Homepage**: http://www.dlink.top/ - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 578 - **Created**: 2022-11-14 - **Last Updated**: 2022-11-14 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # Dinky [![License](https://img.shields.io/badge/license-Apache%202-4EB1BA.svg)](https://www.apache.org/licenses/LICENSE-2.0.html) [![Total Lines](https://tokei.rs/b1/github/DataLinkDC/dlink?category=lines)](https://github.com/DataLinkDC/dlink) [![CN doc](https://img.shields.io/badge/文档-中文版-blue.svg)](README_zh_CN.md) [![EN doc](https://img.shields.io/badge/document-English-blue.svg)](README.md) [![Stargazers over time](https://starchart.cc/DataLinkDC/dlink.svg)](https://starchart.cc/DataLinkDC/dlink) ## Introduction Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake. ## Feature Its main feature are as follows: - Immersive Flink SQL Data Development: Automatic prompt completion, syntax highlighting, statement beautification, online debugging, syntax verification, execution plan, MetaStore, lineage, version comparison, etc. - Support FlinkSQL multi-version development and execution modes: Local,Standalone,Yarn/Kubernetes Session,Yarn Per-Job,Yarn/Kubernetes Application. - Support Apache Flink ecology: Connector,FlinkCDC,Table Store,etc. - Support FlinkSQL syntax enhancement: Table-valued aggregate functions, global variables, execution environments, statement merging, database synchronization, shared sessions, etc. - Supports real-time warehousing and lake entry of the entire FlinkCDC database, multi-database output, and automatic table creation. - Support SQL job development: ClickHouse,Doris,Hive,Mysql,Oracle,Phoenix,PostgreSql,SqlServer,StarRocks,etc. - Support real-time online debugging preview Table, ChangeLog, statistical chart and UDF. - Support Flink Catalog, data source metadata online query and management. - Support real-time task operation and maintenance: Online and offline, job information, cluster information, job snapshot, exception information, data map, data exploration, historical version, alarm record, etc. - Support as multi-version FlinkSQL Server and OpenApi capability. - Support real-time job alarm and alarm group: DingTalk, WeChat, Feishu, E-mail, etc. - Support automatically managed SavePoint/CheckPoint recovery and triggering mechanisms: latest, earliest, specified, etc. - Support resource management: Cluster instance, cluster configuration, Jar, data source, alarm group, alarm instance, document, user, system configuration, etc. - More hidden features are waiting for friends to explore. ## Principle ![dinky_principle](https://raw.githubusercontent.com/DataLinkDC/dlink/main/dlink-doc/images/main/dinky_principle.png) ## Run the Screenshot > FlinkSQL Studio ![datastudio](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/datastudio.png) > Grammar Check ![checksql](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/checksql.png) > Version Management ![versiondiff](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/versiondiff.png) > lineage ![lineage](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/lineage.png) > BI Charts ![charts](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/charts.png) > Metadata Query ![metadata](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/metadata.png) > Task Monitoring ![monitor](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/monitor.png) > Job Information ![jobinfo](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/070/jobinfo.png) ## Near-term Plans - [ ] Multi-tenancy and Namespaces - [ ] Global lineage and influence analysis - [ ] Unified Metadata Management - [x] Flink Metadata Store - [x] Real-time warehouse entry into the lake ## Participate in Contributions Welcome to join the community, build a win-win situation, please refer to the contribution process： [How to contribute](https://github.com/DataLinkDC/dlink/blob/dev/docs/docs/developer_guide/contribution/how_contribute.md). ## How to Deploy See [source code compilation](https://github.com/DataLinkDC/dlink/blob/dev/docs/docs/build_deploy/build.md) and [installation and deployment](https://github.com/DataLinkDC/dlink/blob/dev/docs/docs/build_deploy/deploy.md) for details. ## How to Upgrade Due to many functions, there are many bugs and optimization points. It is strongly recommended to use or upgrade to the latest version. Upgrade steps: (1) Upgrade the app: Replace all dependencies of latest Dinky. (2) Upgrade the DDL: Execute some of the upgrade statements in dlink_history.sql in the sql directory. It is based on the version number and date to determine where to start the execution. Please do not execute all sql directly. ## Thanks Standing on the shoulders of giants, Dinky was born. For this we express our heartfelt thanks to all the open source software used and its communities! We also hope that we are not only beneficiaries of open source, but also contributors to open source. We also hope that partners who have the same enthusiasm and belief in open source will join in and contribute to open source together. A partial list of acknowledgements follows: [Apache Flink](https://github.com/apache/flink) [FlinkCDC](https://github.com/ververica/flink-cdc-connectors) [Apache Flink Table Store](https://github.com/apache/flink-table-store) [Apache Dolphinscheduler](https://github.com/apache/dolphinscheduler) [Apache Doris](https://github.com/apache/doris) [Druid](https://github.com/alibaba/druid) [Ant-Design-Pro](https://github.com/ant-design/ant-design-pro) [Mybatis Plus](https://github.com/baomidou/mybatis-plus) [Monaco Editor](https://github.com/Microsoft/monaco-editor) [Sa Token](https://github.com/dromara/Sa-Token) [SpringBoot]() Thanks to [JetBrains](https://www.jetbrains.com/?from=dlink) for sponsoring a free open source license. [![JetBrains](https://raw.githubusercontent.com/DataLinkDC/dlink/dev/dlink-doc/images/main/jetbrains.svg)](https://www.jetbrains.com/?from=dlink) ## Get Help 1.Submit an issue. 2.Visit the [official website](http://www.dlink.top/#/) website to read the latest documentation manual. 3.It is recommended to scan the code to enter the DingTalk group. dinkydingding 4.Enter the WeChat user community group (recommended, add WeChat `wenmo_ai` to invite into the group) and QQ user community group (**543709668**) to communicate, and apply for the remarks "Dinky + company name + position". 5.Follow the WeChat public account to get the latest official articles: [Dinky Open Source](https://mmbiz.qpic.cn/mmbiz_jpg/dyicwnSlTFTp6w4PuJruFaLV6uShCJDkzqwtnbQJrQ90yKDuuIC8tyMU5DK69XZibibx7EPPBRQ3ic81se5UQYs21g/0?wx_fmt=jpeg). 6.Follow bilibili UP master (Shi Wen Mo A) to get the latest video teaching. ## Copyright Please refer to the [LICENSE](https://github.com/DataLinkDC/dlink/blob/dev/LICENSE) document.