1.构建json文件的时候,当前端填入字段分隔符的时候(比如涉及到hive的时候),例如前端传递 \u0001 ,在后端生成json字符… - #27
Open
Github-lyh wants to merge 16 commits into
Open
Github-lyh wants to merge 16 commits into
Github-lyh wants to merge 16 commits into
Conversation
added 5 commits
September 25, 2020 21:31
…的时候会变成\\u0001(其实是前端刚传递给后端的时候出现的),导致datax不识别。 2.批量构建的时候,加入了对hive的批量构建支持。自动从hive的建表语句中读取各字段信息,封装至json文件中。hive的写入模式增加了truncat模式,如要该模式生效,需替换datax的hivewriter以支持。 3.对sqlserver数据源引入了jtds驱动的方式(jtds能同时支持的sqlserver版本较多),对于datax那边则只需要将jtds的驱动jar包放入对应的文件夹中即可,datax代码无需变动。 4.增加了当新增数据源时,jdbc驱动采用插件的形式创建数据源。在新增数据源或者修改数据源页面,有选项,如果不选择使用pom中的默认驱动,如果想要使用自己的驱动,则只需将驱动的jar文件放入/datax-web-2.1.2/modules/datax-admin/conf文件夹下即可,刷新页面,即可看到新添加的驱动包,选择驱动包创建数据源。
加了个开关按钮用于设置只显示当前项目下的子任务
加了个开关按钮用于设置只显示当前项目下的子任务
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…串的时候会变成\u0001(其实是前端刚传递给后端的时候出现的),导致datax不识别。(这个之前提交过一次,因为我这边代码删除了,所以重新写了下,前端不涉及)
2.批量构建的时候,加入了对hive的批量构建支持。自动从hive的建表语句中读取各字段信息,封装至json文件中。hive的写入模式增加了truncat模式,如要该模式生效,需替换datax的hivewriter以支持。
3.对sqlserver数据源引入了jtds驱动的方式(jtds能同时支持的sqlserver版本较多),对于datax那边则只需要将jtds的驱动jar包放入对应的文件夹中即可,datax代码无需变动。
4.增加了当新增数据源时,jdbc驱动采用插件的形式创建数据源。在新增数据源或者修改数据源页面,有选项,如果不选择使用pom中的默认驱动,如果想要使用自己的驱动,则只需将驱动的jar文件放入/datax-web-2.1.2/modules/datax-admin/conf文件夹下即可,刷新页面,即可看到新添加的驱动包,选择驱动包创建数据源。