Bundle
Resolving “rsync warning: some files vanished before they could be transferred” on ec2-bundle-vol in an aws ec2 instance
This article explains how to resolve some of the common errors that you may encounter when bundling an AMI ( Amazon Machine Image) of an AWS EC2 instance. It is indeed a very good practice bundling your AMI frequently as the latest updates of your app gets stored directly to S3. So even if your instance gets crashed you can launch another instance of your latest ami and get your site back live in minutes!.
But bundling can be a big hassle if we get stuck with rsync errors during the process. There are quite a few cases where rsync fails during bundling.
1) No space left on the device
This usually happens when we specify the size of the / partition with the -s parameter that specifies size, in MB of the image file to create. The maximum size is 10240 MB. Removing the “-s” flag and letting the system determine the size of the image itself will fix it. Also the bundling process will try to include all softlinks ( if any ) to other partitions of larger size ( greater than 10GB ). This would try creating an image file larger than 10GB size and hence throw bundle errors. So check for any softlinks before bundling.
2) Size of /tmp
By Default ec2-bundle-vol will try to bundle the image in /tmp. So if the size of /tmp is small this will throw bundling errors too. Specifying “-d /mnt” to point to the ephemeral drive rather than bundling the image in /tmp by default is a fix for this.
3) rsync warning: some files vanished before they could be transferred
This one is quite an interesting error as it is a warning that some files are being deleted while the bundling process is happening. In my case I had an instance with around 2GB free space in / partition. Also there was a 100GB EBS mounted on /home_ebs. I tried bundling the instance by excluding the 100GB EBS, but still it gave rsync error.
Running Bundle Volume from within a running installation may be problematic because partially written files may get copied into the AMI. To minimize the risk the best option is to stop all non essential services and try rebundling. In my case I removed the /var/log/dcpumon directory and went for a rebudling. That did the trick !.
Please note that using the “–debug” option with ec2-bundle-vol command will be of immense help in troubleshooting bundling errors. Hope this helps anyone out there !
Visit : http://www.migrate2cloud.com/blog/
About the Author
The Bundles
|
|
ematic eGlide 2 tablet bundle $50.00 |
|
|
For Nintendo DS LITE NDSL Charger Accessary Bundle $6.59 |
|
|
Cricut Imagine Electronic Print and Cut Machine Standard Bundle $200.00 |
|
|
Sony PlayStation 1 Dual Shock Controller Bundle Gray Console (NTSC) $25.00 |
|
|
SPAIN 25 PTAS 1928 VF. LOT DEALER. BUNDLE 100 PCS $199.99 |
|
|
NEW BROTHER MFC-8480DN-KIT HEALTHCARE/FINANCE BUNDLE $436.21 |
|
|
Canon CP-220 Compact Photo Printer Kit Bundle $22.99 |
|
|
4 Accessory bundle for HTC EVO V 4G 2x 2050mAh Battery Charger USB Cable Virgin $32.17 |
|
|
Nintendo Wii White Console (NTSC) WITH 3 GAMES BUNDLE $69.99 |
|
|
KRAKEN 2 by Trident Case For HTC EVO 3D Holster Bundle (PINK) $24.99 |
|
|
5 lot accessory bundle travel sleeve case bag chargers for amazon kindle fire 7″ $16.25 |
|
|
3-in-1 Accessories Case Light Film Bundle Kit for Amazon kindle 3 keyboard 3G $9.15 |
|
|
SONY DSC-S650 Bundle Just for Parts L@@K $0.99 |
|
|
Tilda Fabric♥4 X Fat Quarter Bundle ♥ Floral♥Blue Green Pink♥Swedish $19.36 |
|
|
FujiFilm Finepix S3200 Black 14MP Digital Camera Bundle $200.00 |
|
|
All About Animals – Bundles of Babies [VHS], Acceptable VHS, , $1.13 |
|
|
13 ACCESSORY BUNDLE CASE CHARGER For Apple iPhone 3G S $0.99 |
|
|
SPAIN BUNDLE 100x 5 ptas 1935. P 85. SILVER CERTIFICATE. $149.99 |
|
|
ABeka 6th Grade New World History & Geography Bundle $10.51 |
|
|
6 Accessory Bundle Leather Case Kit For Apple iPod i Touch 1st 2G 2nd 3G 3rd Gen $9.99 |
|
|
Slednecks 13 & 14 DVD Bundle Snowmobile Movie Video $49.95 |
|
|
Slednecks 14 DVD & Krazy Canadian Adventures 4 DVD Bundle Snowmobile Video Movie $39.95 |
|
|
3in1 black 360 degree rotating leather case stand stylus bundle for apple ipad 2 $18.59 |
|
|
2 Casio G-SHOCKS 1 Bid… LOT/Bundle Offer (Win 2 NEW G-Shocks) $125.00 |
|
|
Polar RS300X SD (incl. S1 footpod + flowlink) Bundle!!! $170.00 |
|
|
Hauppauge WinTV-HVR-2250 MC Kit Bundle PCIe TV Tuner $114.88 |
|
|
2 accessory bundle for amazon kindle 3 keyboard 3g skin case screen protector $5.49 |
|
|
‘87 Bessie Pease Gutmann BILLY Bundles of Joy Ltd Ed $17.50 |
|
|
Nintendo Wii White Console Bundle with extras $120.00 |
|
|
Sony PSP 3000 Lilac Bundle lot with Extras! games memory card & More $199.99 |
|
|
Olympyk Saw 284Parts all new parts (selling as a bundle of 55 parts) $175.00 |
|
|
16 Accessory Bundle battery HDMI for Sprint HTC EVO 4G $34.19 |
|
|
11 Accessory bundle case charger for sprint htc evo 4G $21.59 |
|
|
2 Black Waterproof Armband Case Skin Accessory Bundle For Apple iPhone 4 4S 32GB $5.91 |
|
|
BOYS NEXT BUNDLE OF 4 TOPS NEXT AGE 1 1/2 -2YRS 2 LONG 2 SHORT SLEEVE SEE PHOTO $3.95 |
|
|
3 pcs Bundle Blue and Grey TPU Cover case + Screen Protector for iPhone 3G 3GS $7.99 |
|
|
14 Accessory bundle case charger for sprint htc evo 4G $25.29 |
|
|
Travel accessory bundle car+wall charger cable for Samsung Galaxy Nexus 16 32GB $6.49 |
|
|
5 New Accessory Bundle Kit Case Car Mount Film For Toshiba Thrive 10.1in Wifi $18.99 |
|
|
BUNDLE 2 X LEE COOPER LONG SLEEVED TOPS MENS/MMANS CLOTHES EXTRA LARGE XL (X66) $7.89 |
|
|
Mint! HP Pavilion dv7t 2.7 17.3″ Ghz Quad i7 6GB 1TB HD Laptop w Case Bundle $1,000.00 |
|
|
7-Needle Wool Felting Embroidery Stitching Punch Tool and Handy Mat Bundle $24.00 |
|
|
Playstation 1 Game Console Bundle with 13 games and 3 Memory Cards $34.99 |
|
|
Skin (Black), Leather Case Cover (Black), and Bundle Nook Simple Touch Reader $31.49 |
|
|
M2 RedRock Adapter, Indie Bundle- HD Edition for NIKON LENSES $450.00 |
|
|
3-item bundle kit for amazon kindle fire silicone skin case+lcd film+stylus pen $8.49 |
|
|
7in1 Tested items Pink Case Stylus bundle kit for ASUS Eee Pad Transformer TF101 $23.99 |
|
|
4in1 Leather Case USB Car+wall charger bundle kit for Apple iphone 4 4G 4S 4TH $7.99 |
|
|
3in1 Universal Stand Holder Film Combo Bundle Kit for Toshiba Thrive Wi-Fi, 7in $15.68 |
|
|
Accessory Bundle for Samsung Galaxy P7510 10.1″ Tab portable foldup stand holder $10.39 |
|
|
3in1 Universal Stand Holder Bundle Kit for Asus Eee Pad Transformer Prime TF201 $16.15 |
|
|
Accessory Bundle for Samsung Galaxy P1000 7″ Tablet portable foldup stand holder $10.47 |
|
|
7in1 Magnetic 360° Rotating Leather Case Swivel Bundle For New iPad 3 3rd Gen $42.99 |
|
|
3in1 Universal Stand Holder Bundle Kit for Asus Eee Pad Transformer Prime TF201 $10.86 |
|
|
6 Clear Diamond TPU Gel Case Cover for iPod Touch 4 G 4th Gen Accessory Bundle $7.80 |
|
|
Land of the Loops , Audio CD, Bundle of Joy $8.88 |
|
|
5in1 Accessory Charger Holder Bundle For HTC EVO 4G HD7 $8.79 |
|
|
NIB Sony PRS-T1 2GB 6″ Wi-Fi eReader+Sony PRSA-CL10 Cover w/Light (Black) Bundle $172.00 |
|
|
Nintendo Wii White Console Bundle $150.00 |
|
|
CyberPower Cat5e Patch Cable Bundle $9.99 |
|
|
DJ Hero Wii Game Bundle Complete $14.99 |
|
|
BLACK DIFFUSER REED 100 BUNDLES 12″ REEDS 10 IN EACH $29.99 |
|
|
3in1 Car Accessory Bundle For Blackberry Bold 9900 9930 $8.75 |
|
|
NEW CHARCOAL GREY SILK MENS NECKTIE NECK TIE CUFFLINKS HANDKERCHIEF BUNDLE SET $5.99 |
|
|
History Movie Bundle $5.99 |
|
|
Two Sony PlayStation 2 Black Consoles SUPER BUNDLE PACKAGE!! $99.00 |
|
|
Black & Decker Cordless Fire Storm 14.4v Circular Saw and 3/8 drill Bundle $39.99 |
|
|
20602 – PINE BUNDLES (Quarter Horse) No. 1,014 of 10,000 $50.00 |
|
|
2 Bundles Of Virgin MALAYSIAN hair 26″ $210.00 |
|
|
6 Accessory Bundle Silicone Gel Case Cover For Apple iPod Nano 6th Generation 6G $3.84 |
|
|
Sleeve Case+3x Screen Protector Bundle Kit for Lenovo IdeaPad K1 Tablet 10.1in $11.99 |
|
|
3 Item Accessories bundle Kit Car+wall charger Cable for Sony Walkman Mp3 Player $6.99 |
|
|
2 Bundles 5 Yards #10 Weight Cheesecloth Cheese Cloth 2X5= 10 yds Fabric $11.00 |
|
|
4in1 Item Silicone Case Stylus Pen Car Mount Bundle Kit for Apple iPad 1 1st Gen $17.29 |
|
|
dreamGEAR BIGDEAL!PAK 15 in 1 Bundle for Game Boy Advance SP $8.99 |
|
|
Restorative & Hydrating Moroccanoil Masks Bundle Moroccan Oil $90.73 |
|
|
Gex & Star Wars Pod Racer Nintendo 64 game BUNDLE $12.00 |
|
|
NEW MID 7″ Google Android 2.2 Tablet PC 4GB Netbook M009 w/ Keyboard Bundle $79.95 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Sky Yel $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Sky Whi $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Sky Blu $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Red $0.99 |
|
|
7 lot Travel accessory bundle case armband charger for Apple Iphone 4 4G 4s gen $13.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Pink $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Green $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Blue $0.99 |
|
|
7in1 Bundle For Asus Eee Pad Transformer Prime TF201 Clear Case Skin Hdmi Cable $19.59 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa G15 Black $0.99 |
|
|
LOT OF 5 x NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC Salsa $6.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC EVO 3D Yellow $0.99 |
|
|
DXG Technology – 3D Camera and 3D Viewer Bundle $61.34 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC EVO 3D Purple $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC EVO 3D Green $0.99 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC EVO 3D Blue $0.99 |
|
|
Vintage Apple Mac mouse microphone pen bundle lot $0.05 |
|
|
NEW SILICONE GEL SLEEVE CASE COVER SKIN SET BUNDLE KIT FOR HTC EVO 3D BLACK $0.99 |
|
|
Total Training TCS5 DESIGN BUNDLE Total Training Cs5 Design Ess Prem Bund DVD $371.84 |
|
|
Texas Instruments – N3CAS/CBX/2L1/B TI-NspireCX CAS Teacher Bundle $243.96 |
|
|
5 Accessory Black Case Charger Cable LCD Bundle For Samsung Galaxy S II i9100 $7.75 |
|
|
NEW CANON EOS 7D DSLR + EF-S EFS 18-55mm IS II LENS BUNDLE $1,335.00 |