Æ£¸¶¤È¿½¤·¤Þ¤¹¡£

¤Ï¤¸¤á¤ÆML¤ËÊÖ¿®¤µ¤»¤Æ¤¤¤¿¤À¤­¤Þ¤¹¡£
¤è¤í¤·¤¯¤ª´ê¤¤Ãפ·¤Þ¤¹¡£

ºÇ¶á¡¢»÷¤¿¤è¤¦¤Ê°Æ·ï¤ò¼ê³Ý¤±¤Æ¤¤¤ë´Ø·¸¤Ç¾¯¤·¾Ü¤·¤¯¤Ê¤ê¤Þ¤·¤¿¤Î¤Ç²óÅú¤µ¤»¤Æ¤¤¤¿¤À¤­¤Þ¤¹¡£

¤¿¤À¡¢Í׷郎¤è¤¯¤ï¤«¤ê¤Þ¤»¤ó¤Î¤Ç¡¢²¿¤È¤â¸À¤¨¤Ê¤¤Éôʬ¤Ï¤¢¤ë¤Î¤Ç¤¹¤¬¡¢¤ß¤Ê¤µ¤ó¤¬¤ª¤Ã¤·¤ã¤é¤ì¤Æ¤¤¤ë¤³¤È¤âƧ¤Þ¤¨¤Æ¤Þ¤È¤á¤Æ¤ß¤ë¤È°Ê²¼¤Î¤è¤¦¤Ç¤Ï¤Ê¤¤¤«¤È»×¤ï¤ì¤Þ¤¹¡£

­¡È֤Τª´«¤á
̵½þ¤Ç¡¢¤¢¤ëÄøÅÙ¼«Ê¬¤¿¤Á¤Ç¼ê¤òÆ°¤«¤»¤ë¾ì¹ç

fluentd¡¢embulk¤¬¤ª¤¹¤¹¤á¤Ç¤¹¡£
DB to DB¤Î¾ì¹ç¤Ï¡¢embulk¤ÎÊý¤¬¹ç¤¦¤È»×¤¤¤Þ¤¹¡£

û¤¤´Ö³Ö¤Ç¥Ð¥Ã¥Á¤Î¤è¤¦¤Ëµ¯Æ°¤·¤Æ¥Ç¡¼¥¿Å¾Á÷¤Ç¤­¤ë¤¿¤á¡¢¤¢¤ëÄøÅÙ¡¢¥ê¥¢¥ë¥¿¥¤¥à¤Ë¤¹¤ë¤³¤È¤â²Äǽ¤Ç¤¢¤ê¡¢¥À¥¦¥ó¥¿¥¤¥à¤â¾¯¤Ê¤¯¤¹¤ë¤³¤È¤¬¤Ç¤­¤Þ¤¹¡£

¥×¥é¥°¥¤¥ó¤Ë¤Ä¤¤¤Æ¤Ï¡¢ÎÓ¤µ¤ó¤¬¤ª¤Ã¤·¤ã¤é¤ì¤¿Ä̤ê¤Ç¤¹¡£¾ðÊóÎ̤⿤¤¤Î¤Ç¼è¤ê³Ý¤«¤ê¤ä¤¹¤¤¤È»×¤¤¤Þ¤¹¡£

°ì²ó¸Â¤ê¤Î¥Þ¥¤¥°¥ì¡¼¥·¥ç¥ó¤Ê¤Î¤«¡¢·Ñ³Ū¤Ê¥Ç¡¼¥¿Å¾Á÷¤¬É¬ÍפʤΤ«¤ï¤«¤ê¤Þ¤»¤ó¤¬¡¢embulk¤Ï¤½¤Î¤É¤Á¤é¤Ë¤â»È¤¨¤ë¤È»×¤¦¤Î¤Ç¶²¤é¤¯Í×·ï¤Ë¹ç¤¦¤È»×¤¤¤Þ¤¹¡£

­¢ÈÖ
MySQL¤À¤±¤Ç¤ä¤ë¾ì¹ç¡¢¤¢¤ëÄøÅ٤κî¤ê¹þ¤ß¤¬É¬ÍפǤ¹¡£

sumiya¤µ¤ó¤Ê¤É¤¬¤ª¤Ã¤·¤ã¤é¤ì¤Æ¤¤¤ëÊýË¡¤â¤¢¤ê¤Þ¤¹¤¬¡¢mysqldump¤Ï¥Ç¡¼¥¿Î̤¬Â¿¤¤¾ì¹ç¡¢¥¨¥¯¥¹¥Ý¡¼¥È¡¢¥¤¥ó¥Ý¡¼¥È¤Ë»þ´Ö¤¬¤«¤«¤ë¤¿¤á¡¢¤¢¤ëÄøÅ٤ΥÀ¥¦¥ó¥¿¥¤¥à¤¬È¯À¸¤¹¤ë²ÄǽÀ­¤¬¤¢¤ë¤«¤È»×¤¤¤Þ¤¹¡£

Í×·ï¤È¤·¤Æ¡¢¥À¥¦¥ó¥¿¥¤¥à¤¬µöÍƤǤ­¤ë¤Ê¤é¤Ð¡¢ºÇ¤â´ðËÜŪ¤Ê¤ä¤êÊý¤«¤È»×¤¤¤Þ¤¹¡£

Workbench¤Ç¤â¥Þ¥¤¥°¥ì¡¼¥·¥ç¥óµ¡Ç½¤¬¤¢¤ê¤Þ¤¹¤¬¡¢¤³¤Á¤é¤Ï»ÈÍѤ·¤¿¤³¤È¤¬¤Ê¤¤¤Î¤Ç¤è¤¯¤ï¤«¤ê¤Þ¤»¤ó¡£¤â¤·¤¹¤ë¤ÈÃ桹»È¤¨¤ë¤Î¤«¤â¤·¤ì¤Þ¤»¤ó¡£

¤Þ¤¿¡¢Ê̤ÎÊýË¡¤È¤·¤Æ¡¢¥½¡¼¥¹Â¦DB¤Ç¥¿¡¼¥²¥Ã¥È¦DB¤Î¥¹¥­¡¼¥Þ¤ÈƱÍͤΥӥ塼¥Æ¡¼¥Ö¥ë¤òºîÀ®¤·¤Æ¤ª¤­¡¢¤½¤ì¤ò¥×¥í¥°¥é¥à¤ÇÃê½Ð¤·¡¢¥¿¡¼¥²¥Ã¥È¦DB¤Ëº¹Ê¬¤Ç¥¤¥ó¥µ¡¼¥È¤¹¤ë¡¢¤È¤¤¤¦ÊýË¡¤â¤¢¤ë¤«¤â¤·¤ì¤Þ¤»¤ó¡£

¤Þ¤¿¤Ï¡¢¥½¡¼¥¹Â¦DB¤Ç¥È¥ê¥¬¡¼¤ò»ÈÍѤ¹¤ë¤È¤¤¤¦ÊýË¡¤ä¡¢LOAD DATA INFILE¹½Ê¸¤ò»È¤¦ÊýË¡¤â¹Í¤¨¤é¤ì¤Þ¤¹¡£

¤³¤Î¥Ó¥å¡¼¥Æ¡¼¥Ö¥ë¡¢¥È¥ê¥¬¡¼¡¢LOAD DATA INFILE¤Î¤¤¤º¤ìÊýË¡¤âºî¤ê¹þ¤ß¤¹¤ì¤Ð¡¢¥À¥¦¥ó¥¿¥¤¥à¤ÎȯÀ¸¤ò¾¯¤Ê¤¯¤·¤ÆÂбþ¤Ç¤­¤ë²ÄǽÀ­¤¬¤¢¤ê¤Þ¤¹¡£

­£ÈÖ
¤¢¤ëÄøÅ٤Τª¶â¤ò¤«¤±¤é¤ì¤ë¾ì¹ç¡¢ETL¥Ä¡¼¥ë¤ò»ÈÍѤ¹¤ëÊýË¡¤¬¤¢¤ê¤Þ¤¹¡£

ETL¥Ä¡¼¥ë¤ÏÃ桹¹â²Á¤Ê¤¿¤á¡¢°ì²ó¸Â¤ê¤Î¥Þ¥¤¥°¥ì¡¼¥·¥ç¥óÍÑÅӤȤ¤¤¦¤è¤ê¤Ï¡¢¶È̳¤Ç¥Ó¥Ã¥°¥Ç¡¼¥¿¤Ê¤É¤ò°·¤¦¤è¤¦¤Ê¶È̳¥·¥¹¥Æ¥à¡¢¥Ç¡¼¥¿¥¦¥§¥¢¥Ï¥¦¥¹¤Ê¤É¤Î·Ñ³Ū¤Ê¥Ç¡¼¥¿Å¾Á÷¤òɬÍפȤ¹¤ë¾ì¹ç¤ËŬ¤·¤Æ¤¤¤Þ¤¹¡£

ÂåɽŪ¤Ê¤â¤Î¤È¤·¤Æ¤Ï¡¢Ìµ½þÈǤǤÏTalend¡¢Pentaho¡¢SymmetricDS¤¢¤¿¤ê¤¬Í­Ì¾¤Ç¤¹¡£

¤Þ¤¿¡¢Í­½þÀ½ÉʤÇÈæ³ÓŪ°Â²Á¤Ê¤â¤Î¤Ï¡¢Asteria Warp¡¢DataSpider¡¢DMExpress¡¢Qanat¤Ê¤É¤¬¤¢¤ê¤Þ¤¹¡£°Â²Á¤È¤¤¤Ã¤Æ¤â¡¢¿ôÉ´Ëü¤¯¤é¤¤¤«¤«¤ê¤Þ¤¹¡£

¤µ¤é¤Ë¹â²Á¤Ê¤â¤Î¤Ç¤Ï¡¢Oracle Goldengate¡¢Oracle Data Integrator¡¢Attunity¡¢DBMoTo¤Ê¤É¤¬¤¢¤ê¤Þ¤¹¡£

ºÇ¶á¤Ï¥¯¥é¥¦¥É¤Ç¤â¡¢ETL¤Î¥µ¡¼¥Ó¥¹¤ò¤ä¤Ã¤Æ¤¤¤ë¤È¤³¤í¤â¤¢¤ê¤Þ¤¹¤·¡¢Ã»´ü´Ö¤Î»ÈÍѤʤé¤Ð¡¢FlyData¤Ê¤É¤¬Í×·ï¤Ë¹ç¤¦¤«¤â¤·¤ì¤Þ¤»¤ó¡£

°Ê¾å¡¢¤è¤í¤·¤¯¤ª´ê¤¤Ãפ·¤Þ¤¹¡£

Æ£¸¶
twitter @yflab

2017ǯ2·î24Æü(¶â) 14:02 ÎÓÇ¡Ìï <yukiya.hayashi@gmail.com>:
ÎӤȿ½¤·¤Þ¤¹¡£

»ä¤âOSS¤ÎETL¥Ä¡¼¥ë¤Î¤´¾Ò²ð¤Ë¤Ê¤ê¤Þ¤¹¤¬¡¢¥È¥ì¥¸¥ã¡¼¥Ç¡¼¥¿¼Ò¤ÎEmbulk¤ò¥ª¥¹¥¹¥á¤·¤Þ¤¹¡£
input,filter,output¤Î£³Ãʳ¬¤Ç¥Ç¡¼¥¿¤ò½èÍý¤¹¤ë¤Î¤Ç¤¹¤¬¡¢Ë­É٤ʥץ饰¥¤¥ó¤Ç½ÀÆð¤Ê½èÍý¤¬¤Ç¤­¤Þ¤¹¡£
¢¨Î㤨¤Ðinput¤òMYSQL¤Ë¡¢output¤òpostgres¤Ë¡¢¤È¤¤¤Ã¤¿»È¤¤Êý¤â²Äǽ

»³ÅĤµ¤ó¤Î¥±¡¼¥¹¤Ç¤Ï¡¢input¤Èoutput¤Çmysql¥×¥é¥°¥¤¥ó¤ò»È¤¦¤À¤±¤ÇÍ×·ï¤òËþ¤¿¤»¤½¤¦¤Ç¤¹¡£
¢¨embulk-output-mysql¤Îcolumn_options¤Îvalue_type¤ò»²¾È¤¯¤À¤µ¤¤

»²¹Í1¡§MySQL¤Îoutput¥×¥é¥°¥¤¥ó

»²¹Í2¡§Embulk¤Î¥×¥é¥°¥¤¥ó°ìÍ÷



2017ǯ2·î24Æü 11:13 HIRATSUKA Sadao <sh2@pop01.odn.ne.jp>:
Ê¿ÄͤǤ¹¡£

¤¤¤ï¤æ¤ëETL¥Ä¡¼¥ë¤ÇÂбþ²Äǽ¤È»×¤¤¤Þ¤¹¡£
°Â²Á¤ËºÑ¤Þ¤»¤ë¤Ê¤éTalend¤È¤¤¤¦OSS¤¬¤¢¤ê¤Þ¤¹¡£
https://jp.talend.com/products/talend-open-studio

¤¿¤ÀʸÌ̤òÇÒ¸«¤¹¤ë¸Â¤ê¡¢ETL¥Ä¡¼¥ë¤ò»ý¤Ã¤Æ¤¯¤ë¤Î¤Ï
µíÅá¤ò¤â¤Ã¤Æ·Ü¤ò³ä¤¯´¶¤¸¤ò¼õ¤±¤Þ¤¹¡£

sumiya¤µ¤ó¤«¤é¤´Äó°Æ¤¤¤¿¤À¤¤¤¿¼ê½ç¤ò´ðËܤȤ·¤Ä¤Ä
¤½¤ì¤Ç¤Ï¤É¤¦¤·¤Æ¤â¤ä¤ê¤¿¤¤¤³¤È¤¬¤Ç¤­¤Ê¤¤¾ì¹ç¤Ë
ETL¥Ä¡¼¥ë¤ò¸¡Æ¤¤¹¤ë¤Î¤¬¤è¤¤¤È»×¤¤¤Þ¤¹¡£

2017ǯ2·î24Æü 11:00 Etsuo SUMIYA <sumiya-e@ube-shinko.co.jp>:

sumiya¤È¤¤¤¤¤Þ¤¹¡£

From: Yamada Shinya <yamada_shinya@interfelix.jp>
Subject: [mysql 16383] mysql¤Î¥Ç¡¼¥¿¥Ù¡¼¥¹¤Î°Ü¹Ô
Date: Fri, 24 Feb 2017 10:41:26 +0900
Message-ID: <53e44762-94f8-71c6-7d2f-17aac7f1b40c@interfelix.jp>

> MySQL¤Î¥Ç¡¼¥¿¥Ù¡¼¥¹¤Î°Ü¹Ô¤ò¸¡Æ¤¤·¤Æ¤¤¤Þ¤¹¡£
> °Ü¹Ô¸µ¤â°Ü¹ÔÀè¤âMySQL¤Î¥Ç¡¼¥¿¥Ù¡¼¥¹¤Ç¤¹¡£
> Âþ¡¢¹½Â¤¤¬°ã¤Ã¤Æ¤¤¤Æ¡¢¥Æ¡¼¥Ö¥ë¤Î¥Õ¥£¡¼¥ë¥Éñ°Ì¤ËÀßÄêÀè¤ò·èÄꤹ¤ëɬÍפ¬
> ¤¢¤ê¤Þ¤¹¡£

¤É¤Î¤è¤¦¤ÊÊѹ¹¤¬É¬ÍפʤΤ«¤ï¤«¤ê¤Þ¤»¤ó¤¬¡¢

1)¸Å¤¤mysql¤Çmysqldump
2)¿·¤·¤¤mysql¤Ç¥¤¥ó¥Ý¡¼¥È
3)ɬÍפÊÊѹ¹¤òALTER table¤Ê¤É¤Ç¡¢¹Ô¤¨¤ë¸Â¤ê¹Ô¤¦¡£
4)¤½¤ì°Ê¾åÊ£»¨¤ÊÊѹ¹¤Ï¥×¥í¥°¥é¥à¤òºî¤ë

°Ê³°¤Ë¤Ê¤¤¤È»×¤¤¤Þ¤¹¡£




--
Ê¿ÄÍÄçÉ× <sh2@pop01.odn.ne.jp>