当前位置： 首页 > news >正文

探索ClickHouse——同时支持导入导出功能的文件格式

news 2026/2/10 19:19:21

在《探索ClickHouse——安装和测试》中，我们使用clickhouse直接从文件中读取数据。clickhouse支持多种格式文件的导入导出，本节我们对此进行分类介绍。

按常见格式区分

JSON

原始的JSON格式只支持导入，不支持导入。同时支持导入和导出的是其他几种类型：

JSONEachRow

{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONStringsEachRow

{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONCompactEachRow

["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRow

["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

按分隔符

TabSeparated

{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSV

"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

Values

(‘{D22473F5-3802-7B40-E053-6C04A8C0A630}’,‘230000’,‘2021-06-09 00:00’,‘CO13 0PQ’,‘D’,‘N’,‘F’,‘4’,‘’,‘BELLAMY CLOSE’,‘KIRBY CROSS’,‘FRINTON-ON-SEA’,‘TENDRING’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3803-7B40-E053-6C04A8C0A630}’,‘700000’,‘2021-06-25 00:00’,‘IG10 4BS’,‘T’,‘N’,‘F’,‘70’,‘’,‘SMARTS LANE’,‘’,‘LOUGHTON’,‘EPPING FOREST’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3804-7B40-E053-6C04A8C0A630}’,‘625000’,‘2021-06-28 00:00’,‘EN9 1LH’,‘S’,‘N’,‘F’,‘7’,‘’,‘THE COBBINS’,‘’,‘WALTHAM ABBEY’,‘EPPING FOREST’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3805-7B40-E053-6C04A8C0A630}’,‘360000’,‘2021-02-17 00:00’,‘SS9 3AU’,‘S’,‘N’,‘F’,‘117’,‘’,‘FLEMMING AVENUE’,‘’,‘LEIGH-ON-SEA’,‘SOUTHEND-ON-SEA’,‘SOUTHEND-ON-SEA’,‘A’,‘A’),(‘{D22473F5-3806-7B40-E053-6C04A8C0A630}’,‘345000’,‘2021-06-25 00:00’,‘SS15 6BG’,‘S’,‘N’,‘F’,‘2’,‘’,‘BROADWATER GREEN’,‘LAINDON’,‘BASILDON’,‘BASILDON’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3807-7B40-E053-6C04A8C0A630}’,‘220000’,‘2021-08-20 00:00’,‘CO7 0HE’,‘S’,‘N’,‘F’,‘133’,‘’,‘CHAPEL ROAD’,‘BRIGHTLINGSEA’,‘COLCHESTER’,‘TENDRING’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3808-7B40-E053-6C04A8C0A630}’,‘362000’,‘2021-06-29 00:00’,‘SS15 4AX’,‘T’,‘N’,‘F’,‘32’,‘’,‘CROUCH STREET’,‘’,‘BASILDON’,‘BASILDON’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-3809-7B40-E053-6C04A8C0A630}’,‘300000’,‘2021-06-25 00:00’,‘CM9 6EP’,‘T’,‘N’,‘F’,‘58’,‘’,‘ORCHARD ROAD’,‘’,‘MALDON’,‘MALDON’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-380A-7B40-E053-6C04A8C0A630}’,‘300000’,‘2021-06-17 00:00’,‘SS4 3AR’,‘T’,‘N’,‘F’,‘32’,‘’,‘ALLERTON CLOSE’,‘’,‘ROCHFORD’,‘ROCHFORD’,‘ESSEX’,‘A’,‘A’),(‘{D22473F5-380B-7B40-E053-6C04A8C0A630}’,‘535000’,‘2021-10-22 00:00’,‘SS9 1PZ’,‘T’,‘N’,‘F’,‘113’,‘’,‘LEIGHTON AVENUE’,‘’,‘LEIGH-ON-SEA’,‘SOUTHEND-ON-SEA’,‘SOUTHEND-ON-SEA’,‘A’,‘A’)

按携带更多信息

只携带字段名

TabSeparatedWithNames

uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSVWithNames

"uuid_string","price_string","time","postcode","a","b","c","addr1","addr2","street","locality","town","district","county","d","e"
"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

携带字段名和类型

TabSeparatedWithNamesAndTypes

uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
String  String  String  String  String  String  String  String  String  String  String  String  String  String  String  String
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

JSONCompactEachRowWithNamesAndTypes

["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRowWithNamesAndTypes

["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

TSKV

uuid_string={D22473F5-3802-7B40-E053-6C04A8C0A630}      price_string=230000     time=2021-06-09 00:00   postcode=CO13 0PQ       a=D     b=N     c=F     addr1=4 addr2=  street=BELLAMY CLOSE    locality=KIRBY CROSS    town=FRINTON-ON-SEA     district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3803-7B40-E053-6C04A8C0A630}      price_string=700000     time=2021-06-25 00:00   postcode=IG10 4BS       a=T     b=N     c=F     addr1=70        addr2=  street=SMARTS LANE      locality=       town=LOUGHTON   district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3804-7B40-E053-6C04A8C0A630}      price_string=625000     time=2021-06-28 00:00   postcode=EN9 1LH        a=S     b=N     c=F     addr1=7 addr2=  street=THE COBBINS      locality=       town=WALTHAM ABBEY      district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3805-7B40-E053-6C04A8C0A630}      price_string=360000     time=2021-02-17 00:00   postcode=SS9 3AU        a=S     b=N     c=F     addr1=117       addr2=  street=FLEMMING AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A
uuid_string={D22473F5-3806-7B40-E053-6C04A8C0A630}      price_string=345000     time=2021-06-25 00:00   postcode=SS15 6BG       a=S     b=N     c=F     addr1=2 addr2=  street=BROADWATER GREEN locality=LAINDON        town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3807-7B40-E053-6C04A8C0A630}      price_string=220000     time=2021-08-20 00:00   postcode=CO7 0HE        a=S     b=N     c=F     addr1=133       addr2=  street=CHAPEL ROAD      locality=BRIGHTLINGSEA  town=COLCHESTER district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3808-7B40-E053-6C04A8C0A630}      price_string=362000     time=2021-06-29 00:00   postcode=SS15 4AX       a=T     b=N     c=F     addr1=32        addr2=  street=CROUCH STREET    locality=       town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3809-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-25 00:00   postcode=CM9 6EP        a=T     b=N     c=F     addr1=58        addr2=  street=ORCHARD ROAD     locality=       town=MALDON     district=MALDON county=ESSEX    d=A     e=A
uuid_string={D22473F5-380A-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-17 00:00   postcode=SS4 3AR        a=T     b=N     c=F     addr1=32        addr2=  street=ALLERTON CLOSE   locality=       town=ROCHFORD   district=ROCHFORD       county=ESSEX    d=A     e=A
uuid_string={D22473F5-380B-7B40-E053-6C04A8C0A630}      price_string=535000     time=2021-10-22 00:00   postcode=SS9 1PZ        a=T     b=N     c=F     addr1=113       addr2=  street=LEIGHTON AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A

RowBinaryWithNamesAndTypes

二进制格式，不支持文本查看。

不可读类型

Native

最高性能的格式。通过二进制格式的块进行写入和读取（即它是基于块的，这和后面介绍的RowBinary系列不同）。它主要用于服务器间交互。
在《探索ClickHouse——使用Projection加速查询》一文中，原始数据是CSV格式，大小约4.6G。导入数据库后约308M。这个数据库的内容导出为Native格式的文件，大小只有约168M。

-rw-rw-r-- 1 fangliang fangliang 176572374 Sep 26 09:19 Native.txt

RowBinary

以二进制格式逐行格式化和解析数据。行和值连续列出，没有分隔符。 这种格式比 Native 格式效率低，因为它是基于行的。
导出这个类型的文件，大概和Native类型的差不多大小。

-rw-rw-r-- 1 fangliang fangliang 176568308 Sep 26 10:12 RowBinary.txt

RowBinaryWithNamesAndTypes

添加头部信息的RowBinary。

其他开源项目类型

Protobuf

Protobuf是一个 Protocol Buffers 格式。此格式需要外部格式描述文件(proto文件)。 该描述文件会进行缓存，以备后续查询。 ClickHouse支持 proto2 和 proto3 语法的proto文件，支持重复/可选/必填字段。

Avro

Apache Avro 是在Apache Hadoop项目中开发的面向行的数据序列化框架。

Parquet

Apache Parquet 是Hadoop生态系统中普遍使用的列式存储格式。

Arrow

Apache Arrow是一种用于内存数据库的格式，共有两种模式，文件与流模式。

ArrowStream

ArrowStream对应的是Arrow的流模式，这种格式适用于内存的流式处理。

ORC

Apache ORC 是Hadoop生态系统中普遍存在的列式存储格式。

其他

Compact和非Compact的区别

非Compact是一条完整符合规则的格式，Compact则是将值变成一个数组保存。以JSONCompactEachRowJSONEachRow为例

# JSONCompactEachRow
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]

# JSONEachRow
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}

String和非String的区别

String会将JSON对象转变为一个字符串。以JSONStringsEachRow和JSONEachRow为例:

#  JSONCompactEachRow
[42,"hello",[1,"a"]] 

# JSONCompactStringsEachRow
["42","hello","(2,'a')"]

导出命令

上述格式可以通过修改下面的命令导出，其中–format用于指定格式。

clickhouse-client --query "SELECT * FROM file('pp-2021.csv', 'CSV', 'uuid_string String, price_string String, time String, postcode String, a String, b String, c String, addr1 String, addr2 String, street String, locality String, town String, district String, county String, d String, e String') LIMIT 10;" --format JSONCompactEachRow > JSONCompactEachRow.txt

查考资料

  • https://clickhouse.com/docs/en/sql-reference/formats

相关文章：

探索ClickHouse——同时支持导入导出功能的文件格式

在《探索ClickHouse——安装和测试》中，我们使用clickhouse直接从文件中读取数据。clickhouse支持多种格式文件的导入导出，本节我们对此进行分类介绍。 按常见格式区分 JSON 原始的JSON格式只支持导入，不支持导入。同时支持导入和导出的是…...

编程日记 2023/10/2 8:40:11

Scipy库提供了多种正态性检验和假设检验方法

Scipy库提供了多种正态性检验和假设检验方法。以下是一些常用的检验方法的列表： 正态性检验方法： Shapiro-Wilk检验：scipy.stats.shapiroAnderson-Darling检验：scipy.stats.andersonKolmogorov-Smirnov检验：scipy.st…...

编程日记 2023/10/2 8:39:10

去雨去雪去雾算法之本地与服务器的TensorBoard使用教程

在进行去雨去雾去雪算法实验时，需要注意几个参数设置，num_workers只能设置为0，否则会报各种稀奇古怪的错误。 本地使用TensorBoard 此外，发现生成的文件是events.out.tfevents格式的，查询了一番得知该文件是通过Tens…...

编程日记 2023/10/2 8:38:10

【小沐学前端】Node.js实现基于Protobuf协议的WebSocket通信

文章目录 1、简介1.1 Node1.2 WebSocket1.3 Protobuf 2、安装2.1 Node2.2 WebSocket2.2.1 nodejs-websocket2.2.2 ws 2.3 Protobuf 3、代码测试3.1 例子1：websocket（html）3.1.1 客户端：yxy_wsclient1.html3.1.2 客户端&#xff1a…...

编程日记 2023/10/2 8:36:07

MySQL学习笔记24

MySQL的物理备份： xtrabackup备份介绍： xtrabackup优缺点： 优点： 1、备份过程快速、可靠（因为是物理备份）；直接拷贝物理文件。 2、支持增量备份，更为灵活； 3、备份…...

编程日记 2023/10/2 8:32:04

objective-c 基础学习

目录 第一节：OC 介绍 ​​第二节：Fundation 框架 ​第三节：NSLog 相对于print 的增强 ​第四节：NSString ​第五节：oc新增数据类型 第六节： 类和对象 ​类的方法的声明与实现 ​第七节：类…...

编程日记 2023/10/2 8:27:59

【精彩回顾】 用sCrypt在Bitcoin上构建智能合约

2023年3月24日，sCrypt在英国Exeter大学举办了关于智能合约的大学讲学。sCrypt首席执行官刘晓晖做了题为“用sCrypt在Bitcoin上构建智能合约”的演讲，并与到场的老师、学生进行了深入交流、互动。这次课程着重讲解了 BSV 智能合约的基础概念，以…...

编程日记 2023/10/2 8:24:57

Kotlin 使用泛型

在 Kotlin 中，我们可以使用泛型（Generics）来编写具有通用性的代码，以增强代码的可重用性和类型安全性。通过使用泛型，我们可以在不指定具体类型的情况下编写适用于多种类型的函数和类。 以下是 Kotlin 中使用泛型的几…...

编程日记 2023/10/2 8:23:56

深度学习 二：COVID 19 Cases Prediction (Regression)

Deep Learning 1. 回归算法思路2. 代码2.1 基础操作2.2 定义相关函数2.3.1 定义图像绘制函数2.3.2 数据集加载及预处理2.3.3 构造数据加载器2.3.4 构建前馈神经网络（Feedforward Neural Network）模型2.3.5 神经网络的训练过程2.3.6 模型评估2.3.7 模型测…...

编程日记 2023/10/2 8:21:54

UG\NX二次开发 信息窗口的4种输出方式 NXOpen::ListingWindow::DeviceType

文章作者：里海 来源网站：《里海NX二次开发3000例专栏》 简介 UG\NX二次开发 信息窗口的4种输出方式 NXOpen::ListingWindow::DeviceType 信息窗口的输出类型 enum NXOpen::ListingWindow::DeviceType 枚举值描述 DeviceTypeWindow0输出将写入“信息”窗口DeviceTypeFile1输出…...

编程日记 2023/10/2 8:19:53

mavn打包时如何把外部依赖加进去？

一、添加依赖: <dependency><groupId>com.dm</groupId><artifactId>DmJdbcDriver</artifactId><version>18</version><scope>system</scope><systemPath>${project.basedir}/lib/DmJdbcDriver18.jar</systemP…...

编程日记 2023/10/2 8:18:52

爬虫代理请求转换selenium添加带有账密的socks5代理

爬虫代理请求转换selenium添加带有账密的socks5代理。 一、安装三方库 二、使用方法 1、在cmd命令行输入&#xff1a; 2、给selenium添加代理 最近因为工作需要&#xff0c;需要selenium添加带有账密的socks5代理&#xff0c;贴出一个可用的方法。 把带有账密的socks5代理&am…...

编程日记 2023/10/2 8:17:51

Redis 如何实现数据不丢失的？

Redis 实现数据不丢失的关键在于使用了多种持久化机制，以确保数据在内存和磁盘之间的持久性。以下是 Redis 实现数据不丢失的主要方法： 快照（Snapshot）持久化： Redis 使用快照持久化来定期将内存中的数据写入磁盘。快照是一个数据库状态的副本，包含了所有键和与其相关联的…...

编程日记 2023/10/2 8:16:50

[高等数学]同济版高等数学【第七版】上下册教材+习题全解PDF

laiyuan 「高等数学 第7版 同济大学」 https://www.aliyundrive.com/s/5fpFJb3asYk 提取码: 61ao 通过百度网盘分享的文件&#xff1a;同济版高数教材及… 链接:https://pan.baidu.com/s/1gyy-GMGjwguAjYijrpC8RA?pwdyhnr 提取码:yhnr 高等数学相关&#xff1a; The Ca…...

编程日记 2023/10/2 8:13:48

【面试题精讲】Java超过long类型的数据如何表示

有的时候博客内容会有变动&#xff0c;首发博客是最新的&#xff0c;其他博客地址可能会未同步,认准https://blog.zysicyj.top 首发博客地址[1] 面试题手册[2] 系列文章地址[3] 在 Java 中&#xff0c;如果需要表示超过 long 类型范围的数据&#xff0c;可以使用 BigInteger 类…...

编程日记 2023/10/2 8:12:47

Shapiro-Wilk正态性检验(Shapiro和Wilk于1965年提出)

Shapiro-Wilk正态性检验是一种用于确定数据集是否服从正态分布的统计方法。它基于Shapiro和Wilk于1965年提出的检验统计量。以下是其基本原理和用途&#xff1a; 基本原理&#xff1a; 零假设&#xff08;Null Hypothesis&#xff09;&#xff1a;Shapiro-Wilk检验的零假设是数…...

编程日记 2023/10/2 8:11:46

debian设置允许ssh连接

解决新debian系统安装后不能通过ssh连接的问题。 默认情况下&#xff0c;Debian系统不开启SSH远程登录&#xff0c;需要手动安装SSH软件包并设置开机启动。 > 设置允许root登录传送门&#xff1a;debian设置允许root登录 首先检查/etc/ssh/sshd_config文件是否存在。 注意…...

编程日记 2023/10/2 8:10:45

【C语言经典100例题-66】（用指针解决）输入3个数a,b,c，按大小顺序输出。

代码&#xff1a; #include<stdio.h> #define _CRT_SECURE_NO_WARNINGS 1//VS编译器使用scanf函数时会报错&#xff0c;所以添加宏定义 swap(p1, p2) int* p1, * p2; {int p;p *p1;*p1 *p2;*p2 p; } int main() {int n1, n2, n3;int* pointer1, * pointer2, * point…...

编程日记 2023/10/2 8:07:42

【STM32 CubeMX】移植u8g2(一次成功)

文章目录 前言一、下载u8g2源文件二、复制和更改文件2.1 复制文件2.2 修改文件u8g2_d_setup文件u8g2_d_memory 三、编写oled.c和oled.h文件3.1 CubeMX配置I2C3.2 编写文件oled.holed.c 四、测试代码main函数测试代码 总结 前言 在本文中&#xff0c;我们将介绍如何在STM32上成…...

编程日记 2023/10/2 8:01:37

华为云智能化组装式交付方案 ——金融级PaaS业务洞察及Web3实践的卓越贡献

伴随信息技术与金融业务加速的融合&#xff0c;企业应用服务平台&#xff08;PaaS&#xff09;已从幕后走向台前&#xff0c;成为推动行业数字化转型的关键力量。此背景下&#xff0c;华为云PaaS智能化组装式交付方案闪耀全场&#xff0c;在近日结束的华为全联接大会 2023上倍受…...

编程日记 2023/10/2 7:58:33

在软件开发中正确使用MySQL日期时间类型的深度解析

在日常软件开发场景中&#xff0c;时间信息的存储是底层且核心的需求。从金融交易的精确记账时间、用户操作的行为日志&#xff0c;到供应链系统的物流节点时间戳&#xff0c;时间数据的准确性直接决定业务逻辑的可靠性。MySQL作为主流关系型数据库&#xff0c;其日期时间类型的…...

编程新知 2025/10/16 13:22:06

生成xcframework

打包 XCFramework 的方法 XCFramework 是苹果推出的一种多平台二进制分发格式&#xff0c;可以包含多个架构和平台的代码。打包 XCFramework 通常用于分发库或框架。 使用 Xcode 命令行工具打包 通过 xcodebuild 命令可以打包 XCFramework。确保项目已经配置好需要支持的平台…...

编程新知 2025/10/5 2:30:38

基于服务器使用 apt 安装、配置 Nginx

&#x1f9fe; 一、查看可安装的 Nginx 版本 首先&#xff0c;你可以运行以下命令查看可用版本&#xff1a; apt-cache madison nginx-core输出示例&#xff1a; nginx-core | 1.18.0-6ubuntu14.6 | http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages ng…...

编程新知 2026/1/9 12:53:59

高频面试之3Zookeeper

高频面试之3Zookeeper 文章目录 高频面试之3Zookeeper3.1 常用命令3.2 选举机制3.3 Zookeeper符合法则中哪两个&#xff1f;3.4 Zookeeper脑裂3.5 Zookeeper用来干嘛了 3.1 常用命令 ls、get、create、delete、deleteall3.2 选举机制 半数机制&#xff08;过半机制&#xff0…...

编程新知 2026/1/25 13:13:20

论文浅尝 | 基于判别指令微调生成式大语言模型的知识图谱补全方法（ISWC2024）

笔记整理&#xff1a;刘治强&#xff0c;浙江大学硕士生&#xff0c;研究方向为知识图谱表示学习&#xff0c;大语言模型 论文链接&#xff1a;http://arxiv.org/abs/2407.16127 发表会议&#xff1a;ISWC 2024 1. 动机 传统的知识图谱补全&#xff08;KGC&#xff09;模型通过…...

编程新知 2026/2/10 15:49:34

【AI学习】三、AI算法中的向量

在人工智能&#xff08;AI&#xff09;算法中&#xff0c;向量&#xff08;Vector&#xff09;是一种将现实世界中的数据&#xff08;如图像、文本、音频等&#xff09;转化为计算机可处理的数值型特征表示的工具。它是连接人类认知&#xff08;如语义、视觉特征&#xff09;与…...

编程新知 2026/1/1 14:01:45

Axios请求超时重发机制

Axios 超时重新请求实现方案 在 Axios 中实现超时重新请求可以通过以下几种方式&#xff1a; 1. 使用拦截器实现自动重试 import axios from axios;// 创建axios实例 const instance axios.create();// 设置超时时间 instance.defaults.timeout 5000;// 最大重试次数 cons…...

编程新知 2025/10/13 2:26:14

大模型多显卡多服务器并行计算方法与实践指南

一、分布式训练概述 大规模语言模型的训练通常需要分布式计算技术，以解决单机资源不足的问题。分布式训练主要分为两种模式： 数据并行：将数据分片到不同设备，每个设备拥有完整的模型副本 模型并行：将模型分割到不同设备，每个设备处理部分模型计算 现代大模型训练通常结合…...

编程新知 2025/12/10 20:45:02

拉力测试cuda pytorch 把 4070显卡拉满

import torch import timedef stress_test_gpu(matrix_size16384, duration300):"""对GPU进行压力测试&#xff0c;通过持续的矩阵乘法来最大化GPU利用率参数:matrix_size: 矩阵维度大小&#xff0c;增大可提高计算复杂度duration: 测试持续时间&#xff08;秒&…...

编程新知 2025/12/7 12:35:20

用机器学习破解新能源领域的“弃风”难题

音乐发烧友深有体会&#xff0c;玩音乐的本质就是玩电网。火电声音偏暖&#xff0c;水电偏冷&#xff0c;风电偏空旷。至于太阳能发的电&#xff0c;则略显朦胧和单薄。 不知你是否有感觉&#xff0c;近两年家里的音响声音越来越冷&#xff0c;听起来越来越单薄&#xff1f; —…...

编程新知 2026/2/7 22:13:48