# StreamX
**Repository Path**: fat-good-projects-collect/streamx
## Basic Information
- **Project Name**: StreamX
- **Description**: 一个神奇的框架,让Flink&Spark开发更简单!一站式大数据实时平台.
- **Primary Language**: Scala
- **License**: Apache-2.0
- **Default Branch**: dev
- **Homepage**: None
- **GVP Project**: No
## Statistics
- **Stars**: 0
- **Forks**: 383
- **Created**: 2022-03-21
- **Last Updated**: 2022-09-09
## Categories & Tags
**Categories**: Uncategorized
**Tags**: None
## README
Make stream processing easier!!!
**[Official Website](http://www.streamxhub.com)** |
**[Change Log](#)** |
**[Document](https://www.streamxhub.com/docs/intro)**
#### English | [中文](README_CN.md)
# Apache StreamPark (Incubating)
Make stream processing easier
> A magical framework that make stream processing easier!
## 🚀 Introduction
Apache Flink and Apache Spark are widely used as the next generation of big data streaming computing engines. Based on a bench of excellent experiences combined with best practices, we extracted the task deployment and runtime parameters into the configuration files. In this way, an easy-to-use RuntimeContext with out-of-the-box connectors would bring easier and more efficient task development experience. It reduces the learning cost and development barriers, hence developers can focus on the business logic.
On the other hand, It can be challenge for enterprises to use Flink & Spark if there is no professional management platform for Flink & Spark tasks during the deployment phase. StreamPark provides such a professional task management platform, including task development, scheduling, interactive query, deployment, operation, maintenance, etc.
[](http://assets.streamxhub.com/streamx-video.mp4)
## 🎉 Features
* Apache Flink & Spark application development scaffolding
* Out-of-the-box connectors
* Support maven compilation
* Support multiple versions of Flink & Spark
* Scala 2.11 / 2.12 support
* One-stop stream processing operation platform
* Support catalog、olap、streaming-warehouse etc.
* ...
## 🏳🌈 Components
`StreamPark` consists of three parts,`streampark-core`,`streampark-pump` and `streampark-console`
### 1️⃣ streampark-core
`streampark-core` is a framework that focuses on coding, standardizes configuration, and develops in a way that is better than configuration by
convention. Also it provides a development-time `RunTime Content` and a series of `Connector` out of the box. make application development easier
developer focus on the business itself, and improve development efficiency and development experience.
### 2️⃣ streampark-pump
`streampark-pump` is a planned data extraction component. Based on the various `connector` provided in `streampark-core`, the
purpose is to create a convenient, fast, out-of-the-box real-time data extraction and migration component for big data, and it will be
integrated into the `streampark-console`.
### 3️⃣ streampark-console
`streampark-console` is a stream processing and `Low Code` platform, capable of managing `Flink` & `Spark` tasks, integrating project compilation,
deploy, configuration, startup, `savepoint`, `flame graph`, monitoring and many other features. Simplify the daily operation
and maintenance of the `Flink` & `Spark` task.
Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse.
* [Apache Flink](http://flink.apache.org)
* [Apache Spark](http://spark.apache.org)
* [Apache YARN](http://hadoop.apache.org)
* [Spring Boot](https://spring.io/projects/spring-boot/)
* [Mybatis](http://www.mybatis.org)
* [Mybatis-Plus](http://mp.baomidou.com)
* [Flame Graph](http://www.brendangregg.com/FlameGraphs)
* [JVM-Profiler](https://github.com/uber-common/jvm-profiler)
* [Vue](https://cn.vuejs.org/)
* [VuePress](https://vuepress.vuejs.org/)
* [Ant Design of Vue](https://antdv.com/)
* [ANTD PRO VUE](https://pro.antdv)
* [xterm.js](https://xtermjs.org/)
* [Monaco Editor](https://microsoft.github.io/monaco-editor/)
* ...
Thanks for the respect given by the above excellent open source projects and many unmentioned excellent open source projects
## 🚀 Quick Start
click [Document](https://www.streamxhub.com/docs/intro) for more information
## 💋 our users
Various companies and organizations use StreamPark for research, production and commercial products. Are you using this project ? [you can add your company](https://github.com/streamxhub/streamx/issues/163)
## 🏆 Our honor
We have received some precious honors, which belong to everyone who contributes to StreamPark, Thank you !
## 🤝 Contribution
[](https://github.com/streamxhub/streamx/pulls)
You can submit any ideas as [pull requests](https://github.com/streamxhub/streamx/pulls) or as [GitHub issues](https://github.com/streamxhub/streamx/issues/new/choose).
> If you're new to posting issues, we ask that you read [*How To Ask Questions The Smart Way*](http://www.catb.org/~esr/faqs/smart-questions.html) (**This guide does not provide actual support services for this project!**), [How to Report Bugs Effectively](http://www.chiark.greenend.org.uk/~sgtatham/bugs.html) prior to posting. Well written bug reports help us help you!
Thank you to all the people who already contributed to StreamPark!
## ⏰ Contributor Over Time
[](https://git-contributor.com?chart=contributorOverTime&repo=streamxhub/streamx)
## 💬 Join us
[StreamPark]((http://www.streamxhub.com/#/)) enters the high-speed development stage, we need your contribution.
