# Expected time to complete mapping

**URL:** <https://community.neo4j.com/t/expected-time-to-complete-mapping/5003>\
**Category:** ETL-Tool\
**Created:** [February 11, 2019, 7:12pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003 "2019-02-11T19:12:43Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![alcampopiano](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/alcampopiano/32/3162_2.png) [@alcampopiano](https://community.neo4j.com/u/alcampopiano)\
**Post date:** [February 11, 2019, 7:12pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/1 "2019-02-11T19:12:43Z")

</div>

Hi all,

I'm using the ETL tool to map my organization's relational database. Their database has decades of data across roughly 7000 tables.

I am currently doing the mapping step (not the importing) and it has been running for 6 hours.

I'm totally fine with waiting but just wanted to ask if the mapping step is potentially a long process? If not I can kill the process and investigate further.

```auto
neo4j browser: 3.2.17
ETL tool 1.3.6

```

Thanks very much,  
Al

---

<div class="post-metadata">

**Author:** ![alcampopiano](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/alcampopiano/32/3162_2.png) [@alcampopiano](https://community.neo4j.com/u/alcampopiano)\
**Post date:** [February 13, 2019, 4:07pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/2 "2019-02-13T16:07:42Z")

</div>

Not sure what to expect, but it ran the mapping step for 2 days and it hadn't finished. I assumed something was wrong so I cancelled it and will investigate further.

Any advice as to whether or not the mapping stage should take minutes, hours, or days would be much appreciated.

Al

---

<div class="post-metadata">

**Author:** ![akshaya.mishra254](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/akshaya.mishra254/32/4786_2.png) [@akshaya.mishra254](https://community.neo4j.com/u/akshaya.mishra254)\
**Post date:** [September 17, 2019, 2:34pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/3 "2019-09-17T14:34:09Z")

</div>

Even for 1 table also It is not proceeding further after Carawling.. step.

 ![neo4j](https://us1.discourse-cdn.com/flex021/uploads/neo4jcommunity/original/2X/2/2effd318a7a8946f04356b3856c7d653565f748b.png)

---

<div class="post-metadata">

**Author:** ![dominicvivek06](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/dominicvivek06/32/5034_2.png) [@dominicvivek06](https://community.neo4j.com/u/dominicvivek06)\
**Post date:** [September 18, 2019, 10:58am UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/4 "2019-09-18T10:58:01Z")

</div>

Since this is an old post, I am not sure, if you question was already answered ....

(1) What is the database size ?  
(2) What is the size of each tables ?

---

<div class="post-metadata">

**Author:** ![susmitadaskgp](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/susmitadaskgp/32/15406_2.png) [@susmitadaskgp](https://community.neo4j.com/u/susmitadaskgp)\
**Post date:** [December 30, 2020, 2:28pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/5 "2020-12-30T14:28:01Z")

</div>

Hii,  
I am also having the same issue regarding the etl tool . Can anyone please answer that how long would it take to map around 1000 tables.

---

<div class="post-metadata">

**Author:** ![dominicvivek06](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/dominicvivek06/32/5034_2.png) [@dominicvivek06](https://community.neo4j.com/u/dominicvivek06)\
**Post date:** [December 30, 2020, 5:11pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/6 "2020-12-30T17:11:04Z")

</div>

Hi @susmitadaskgp, there is no static value. It all depends on your Data Model with Entities and Relationships.  
What database are you using ? Before mapping did you had a check with the Data Dictionary ?

---

<div class="post-metadata">

**Author:** ![clem](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/clem/32/4364_2.png) [@clem](https://community.neo4j.com/u/clem)\
**Post date:** [December 30, 2020, 5:54pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/7 "2020-12-30T17:54:50Z")

</div>

I highly recommend using a small sampling of the existing data before doing a massive import.

It may take multiple tries to debug it, so there will be occasions where you'll be waiting for a long time, only to discover the data wasn't imported correctly.

Also, you can get an estimate for the total time. i.e. if you load 1% of the data, you can estimate the total time by multiplying by 100.

The other thing I recommend is to clone the DB at each step as a backup if you do multiple steps. That way, if a step messes up the data, then you can go back to the previously good DB.

---

<div class="post-metadata">

**Author:** ![dominicvivek06](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/dominicvivek06/32/5034_2.png) [@dominicvivek06](https://community.neo4j.com/u/dominicvivek06)\
**Post date:** [December 30, 2020, 6:14pm UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/8 "2020-12-30T18:14:43Z")

</div>

Hi @susmitadaskgp, are you migrating a OLTP or a OLAP database ? Maybe not all the 1000 tables, you have to migrate. You can create intermediate views also in the source database. There are always so many options to choose from.

Always have discovery and identifications of entities process first. This will save a lot of time.

---

<div class="post-metadata">

**Author:** ![dominicvivek06](https://sea1.discourse-cdn.com/flex021/user_avatar/community.neo4j.com/dominicvivek06/32/5034_2.png) [@dominicvivek06](https://community.neo4j.com/u/dominicvivek06)\
**Post date:** [December 31, 2020, 9:52am UTC](https://community.neo4j.com/t/expected-time-to-complete-mapping/5003/10 "2020-12-31T09:52:14Z")

</div>

@susmitadaskgp, like I guess, I think you are migrating an OLAP database. Sure, I can help you. Before I can advise more on this, I need more in-depth knowledge on the data. If you want we can connect in skype dominicvivek06 , and discuss there further.
